[==========] Running 13 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 3 tests from LeadershipChangeReportingTest
[ RUN ] LeadershipChangeReportingTest.TestConcurrentGetTableLocations
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260201 08:59:17.455929 18612 thread.cc:641] rpc reactor (reactor) Time spent creating pthread: real 1.082s user 0.430s sys 0.649s
W20260201 08:59:17.456645 18612 thread.cc:608] rpc reactor (reactor) Time spent starting thread: real 1.083s user 0.430s sys 0.649s
I20260201 08:59:17.460121 18612 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.45.62:42383
I20260201 08:59:17.462059 18612 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 08:59:17.463189 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:17.475600 18623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:17.476562 18624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:17.626159 18626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:17.626925 18612 server_base.cc:1060] running on GCE node
I20260201 08:59:17.627918 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:17.628139 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:17.628397 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936357628357 us; error 0 us; skew 500 ppm
I20260201 08:59:17.629172 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:17.633895 18612 webserver.cc:492] Webserver started at http://127.18.45.62:37869/ using document root <none> and password file <none>
I20260201 08:59:17.634725 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:17.634944 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:17.635381 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:17.640617 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1769936356186478-18612-0/minicluster-data/master-0-root/instance:
uuid: "84f6a9ad97c34f5b8dbee0f5e57a5ab1"
format_stamp: "Formatted at 2026-02-01 08:59:17 on dist-test-slave-zz6f"
I20260201 08:59:17.647653 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260201 08:59:17.652367 18631 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:17.653518 18612 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260201 08:59:17.653846 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1769936356186478-18612-0/minicluster-data/master-0-root
uuid: "84f6a9ad97c34f5b8dbee0f5e57a5ab1"
format_stamp: "Formatted at 2026-02-01 08:59:17 on dist-test-slave-zz6f"
I20260201 08:59:17.654182 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1769936356186478-18612-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1769936356186478-18612-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1769936356186478-18612-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:17.671420 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:17.672716 18612 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 08:59:17.673153 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:17.738004 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.62:42383
I20260201 08:59:17.738072 18682 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.62:42383 every 8 connection(s)
I20260201 08:59:17.743330 18683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.762943 18683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1: Bootstrap starting.
I20260201 08:59:17.768412 18683 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:17.769979 18683 log.cc:826] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1: Log is configured to *not* fsync() on all Append() calls
I20260201 08:59:17.773864 18683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1: No bootstrap required, opened a new log
I20260201 08:59:17.791657 18683 raft_consensus.cc:359] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84f6a9ad97c34f5b8dbee0f5e57a5ab1" member_type: VOTER }
I20260201 08:59:17.792068 18683 raft_consensus.cc:385] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:17.792363 18683 raft_consensus.cc:740] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84f6a9ad97c34f5b8dbee0f5e57a5ab1, State: Initialized, Role: FOLLOWER
I20260201 08:59:17.793048 18683 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84f6a9ad97c34f5b8dbee0f5e57a5ab1" member_type: VOTER }
I20260201 08:59:17.793536 18683 raft_consensus.cc:399] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 08:59:17.793828 18683 raft_consensus.cc:493] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 08:59:17.794134 18683 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:17.797709 18683 raft_consensus.cc:515] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84f6a9ad97c34f5b8dbee0f5e57a5ab1" member_type: VOTER }
I20260201 08:59:17.798341 18683 leader_election.cc:304] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 84f6a9ad97c34f5b8dbee0f5e57a5ab1; no voters:
I20260201 08:59:17.799861 18683 leader_election.cc:290] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 08:59:17.800217 18686 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:17.802217 18686 raft_consensus.cc:697] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1 [term 1 LEADER]: Becoming Leader. State: Replica: 84f6a9ad97c34f5b8dbee0f5e57a5ab1, State: Running, Role: LEADER
I20260201 08:59:17.803020 18686 consensus_queue.cc:237] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84f6a9ad97c34f5b8dbee0f5e57a5ab1" member_type: VOTER }
I20260201 08:59:17.804032 18683 sys_catalog.cc:565] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1 [sys.catalog]: configured and running, proceeding with master startup.
I20260201 08:59:17.809722 18688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84f6a9ad97c34f5b8dbee0f5e57a5ab1. Latest consensus state: current_term: 1 leader_uuid: "84f6a9ad97c34f5b8dbee0f5e57a5ab1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84f6a9ad97c34f5b8dbee0f5e57a5ab1" member_type: VOTER } }
I20260201 08:59:17.810488 18688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1 [sys.catalog]: This master's current role is: LEADER
I20260201 08:59:17.810426 18687 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "84f6a9ad97c34f5b8dbee0f5e57a5ab1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84f6a9ad97c34f5b8dbee0f5e57a5ab1" member_type: VOTER } }
I20260201 08:59:17.811122 18687 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1 [sys.catalog]: This master's current role is: LEADER
I20260201 08:59:17.815186 18693 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 08:59:17.826560 18693 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 08:59:17.828178 18612 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260201 08:59:17.840642 18693 catalog_manager.cc:1357] Generated new cluster ID: 9fb60058c76441b686bc753f378e1e27
I20260201 08:59:17.840875 18693 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 08:59:17.855124 18693 catalog_manager.cc:1380] Generated new certificate authority record
I20260201 08:59:17.856642 18693 catalog_manager.cc:1514] Loading token signing keys...
I20260201 08:59:17.870920 18693 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1: Generated new TSK 0
I20260201 08:59:17.871717 18693 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 08:59:17.894186 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:17.901391 18705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:17.903002 18706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:17.905380 18612 server_base.cc:1060] running on GCE node
W20260201 08:59:17.906154 18708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:17.906944 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:17.907150 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:17.907320 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936357907299 us; error 0 us; skew 500 ppm
I20260201 08:59:17.907825 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:17.911770 18612 webserver.cc:492] Webserver started at http://127.18.45.1:35935/ using document root <none> and password file <none>
I20260201 08:59:17.912276 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:17.912497 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:17.912747 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:17.913944 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1769936356186478-18612-0/minicluster-data/ts-0-root/instance:
uuid: "9a375cdc88b74c1ab6ca7aa371de2c56"
format_stamp: "Formatted at 2026-02-01 08:59:17 on dist-test-slave-zz6f"
I20260201 08:59:17.919312 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260201 08:59:17.923522 18713 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:17.924367 18612 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260201 08:59:17.924676 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1769936356186478-18612-0/minicluster-data/ts-0-root
uuid: "9a375cdc88b74c1ab6ca7aa371de2c56"
format_stamp: "Formatted at 2026-02-01 08:59:17 on dist-test-slave-zz6f"
I20260201 08:59:17.924996 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1769936356186478-18612-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1769936356186478-18612-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1769936356186478-18612-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:17.942698 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:17.943885 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:17.946449 18612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:59:17.950786 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:59:17.950989 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:17.951303 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:59:17.951439 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:18.051452 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.1:38163
I20260201 08:59:18.051523 18775 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.1:38163 every 8 connection(s)
I20260201 08:59:18.058458 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:18.071636 18780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:18.074347 18781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:18.083077 18783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:18.084674 18612 server_base.cc:1060] running on GCE node
I20260201 08:59:18.085695 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:18.085937 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:18.086125 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936358086106 us; error 0 us; skew 500 ppm
I20260201 08:59:18.086781 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:18.087534 18776 heartbeater.cc:344] Connected to a master server at 127.18.45.62:42383
I20260201 08:59:18.088042 18776 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:18.088961 18776 heartbeater.cc:507] Master 127.18.45.62:42383 requested a full tablet report, sending...
I20260201 08:59:18.090072 18612 webserver.cc:492] Webserver started at http://127.18.45.2:44241/ using document root <none> and password file <none>
I20260201 08:59:18.090714 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:18.090935 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:18.091225 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:18.091970 18648 ts_manager.cc:194] Registered new tserver with Master: 9a375cdc88b74c1ab6ca7aa371de2c56 (127.18.45.1:38163)
I20260201 08:59:18.092610 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1769936356186478-18612-0/minicluster-data/ts-1-root/instance:
uuid: "d8e942113a444a99add32159e588adcd"
format_stamp: "Formatted at 2026-02-01 08:59:18 on dist-test-slave-zz6f"
I20260201 08:59:18.093986 18648 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35372
I20260201 08:59:18.098542 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260201 08:59:18.103003 18788 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:18.103835 18612 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260201 08:59:18.104138 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1769936356186478-18612-0/minicluster-data/ts-1-root
uuid: "d8e942113a444a99add32159e588adcd"
format_stamp: "Formatted at 2026-02-01 08:59:18 on dist-test-slave-zz6f"
I20260201 08:59:18.104482 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1769936356186478-18612-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1769936356186478-18612-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1769936356186478-18612-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:18.149425 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:18.150627 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:18.152108 18612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:59:18.155491 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:59:18.155639 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:18.155872 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:59:18.156006 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:18.196717 18776 heartbeater.cc:499] Master 127.18.45.62:42383 was elected leader, sending a full tablet report...
I20260201 08:59:18.254590 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.2:38631
I20260201 08:59:18.255240 18850 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.2:38631 every 8 connection(s)
I20260201 08:59:18.275179 18851 heartbeater.cc:344] Connected to a master server at 127.18.45.62:42383
I20260201 08:59:18.275537 18851 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:18.276284 18851 heartbeater.cc:507] Master 127.18.45.62:42383 requested a full tablet report, sending...
I20260201 08:59:18.277949 18648 ts_manager.cc:194] Registered new tserver with Master: d8e942113a444a99add32159e588adcd (127.18.45.2:38631)
I20260201 08:59:18.278659 18612 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.013178931s
I20260201 08:59:18.279402 18648 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35376
I20260201 08:59:18.305500 18648 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35378:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 2
seed: 0
}
range_schema {
columns {
name: "key"
}
}
}
W20260201 08:59:18.322338 18648 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 3 tablet servers would be needed, 2 are available. Consider bringing up more tablet servers.
I20260201 08:59:18.374342 18741 tablet_service.cc:1505] Processing CreateTablet for tablet a18c6cc9da4a4af897c2274b4b5e69ba (DEFAULT_TABLE table=test-table [id=43335d6e13a746d0bb850362704350d6]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260201 08:59:18.374516 18740 tablet_service.cc:1505] Processing CreateTablet for tablet fc18e45f08254428bea325a8035ce5cd (DEFAULT_TABLE table=test-table [id=43335d6e13a746d0bb850362704350d6]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260201 08:59:18.375628 18741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a18c6cc9da4a4af897c2274b4b5e69ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.376205 18740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc18e45f08254428bea325a8035ce5cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.381913 18851 heartbeater.cc:499] Master 127.18.45.62:42383 was elected leader, sending a full tablet report...
I20260201 08:59:18.382252 18816 tablet_service.cc:1505] Processing CreateTablet for tablet a18c6cc9da4a4af897c2274b4b5e69ba (DEFAULT_TABLE table=test-table [id=43335d6e13a746d0bb850362704350d6]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260201 08:59:18.383474 18816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a18c6cc9da4a4af897c2274b4b5e69ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.383904 18815 tablet_service.cc:1505] Processing CreateTablet for tablet fc18e45f08254428bea325a8035ce5cd (DEFAULT_TABLE table=test-table [id=43335d6e13a746d0bb850362704350d6]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260201 08:59:18.385121 18815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc18e45f08254428bea325a8035ce5cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.405864 18864 tablet_bootstrap.cc:492] T fc18e45f08254428bea325a8035ce5cd P 9a375cdc88b74c1ab6ca7aa371de2c56: Bootstrap starting.
I20260201 08:59:18.411206 18864 tablet_bootstrap.cc:654] T fc18e45f08254428bea325a8035ce5cd P 9a375cdc88b74c1ab6ca7aa371de2c56: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:18.413846 18865 tablet_bootstrap.cc:492] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd: Bootstrap starting.
I20260201 08:59:18.417016 18864 tablet_bootstrap.cc:492] T fc18e45f08254428bea325a8035ce5cd P 9a375cdc88b74c1ab6ca7aa371de2c56: No bootstrap required, opened a new log
I20260201 08:59:18.417404 18864 ts_tablet_manager.cc:1403] T fc18e45f08254428bea325a8035ce5cd P 9a375cdc88b74c1ab6ca7aa371de2c56: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.001s
I20260201 08:59:18.419427 18865 tablet_bootstrap.cc:654] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:18.419795 18864 raft_consensus.cc:359] T fc18e45f08254428bea325a8035ce5cd P 9a375cdc88b74c1ab6ca7aa371de2c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 } } peers { permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 } }
I20260201 08:59:18.420403 18864 raft_consensus.cc:740] T fc18e45f08254428bea325a8035ce5cd P 9a375cdc88b74c1ab6ca7aa371de2c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a375cdc88b74c1ab6ca7aa371de2c56, State: Initialized, Role: FOLLOWER
I20260201 08:59:18.420935 18864 consensus_queue.cc:260] T fc18e45f08254428bea325a8035ce5cd P 9a375cdc88b74c1ab6ca7aa371de2c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 } } peers { permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 } }
I20260201 08:59:18.425312 18864 ts_tablet_manager.cc:1434] T fc18e45f08254428bea325a8035ce5cd P 9a375cdc88b74c1ab6ca7aa371de2c56: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20260201 08:59:18.425483 18865 tablet_bootstrap.cc:492] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd: No bootstrap required, opened a new log
I20260201 08:59:18.425921 18865 ts_tablet_manager.cc:1403] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.003s
I20260201 08:59:18.426124 18864 tablet_bootstrap.cc:492] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56: Bootstrap starting.
I20260201 08:59:18.428478 18865 raft_consensus.cc:359] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 } } peers { permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 } }
I20260201 08:59:18.429176 18865 raft_consensus.cc:740] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8e942113a444a99add32159e588adcd, State: Initialized, Role: FOLLOWER
I20260201 08:59:18.430374 18865 consensus_queue.cc:260] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 } } peers { permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 } }
I20260201 08:59:18.432353 18864 tablet_bootstrap.cc:654] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:18.439245 18865 ts_tablet_manager.cc:1434] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd: Time spent starting tablet: real 0.013s user 0.002s sys 0.003s
I20260201 08:59:18.440079 18865 tablet_bootstrap.cc:492] T fc18e45f08254428bea325a8035ce5cd P d8e942113a444a99add32159e588adcd: Bootstrap starting.
I20260201 08:59:18.443513 18864 tablet_bootstrap.cc:492] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56: No bootstrap required, opened a new log
I20260201 08:59:18.443966 18864 ts_tablet_manager.cc:1403] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.010s
I20260201 08:59:18.446322 18865 tablet_bootstrap.cc:654] T fc18e45f08254428bea325a8035ce5cd P d8e942113a444a99add32159e588adcd: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:18.446425 18864 raft_consensus.cc:359] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 } } peers { permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 } }
I20260201 08:59:18.447199 18864 raft_consensus.cc:740] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a375cdc88b74c1ab6ca7aa371de2c56, State: Initialized, Role: FOLLOWER
I20260201 08:59:18.447743 18864 consensus_queue.cc:260] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 } } peers { permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 } }
I20260201 08:59:18.452319 18864 ts_tablet_manager.cc:1434] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20260201 08:59:18.455488 18865 tablet_bootstrap.cc:492] T fc18e45f08254428bea325a8035ce5cd P d8e942113a444a99add32159e588adcd: No bootstrap required, opened a new log
I20260201 08:59:18.455868 18865 ts_tablet_manager.cc:1403] T fc18e45f08254428bea325a8035ce5cd P d8e942113a444a99add32159e588adcd: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.011s
I20260201 08:59:18.458045 18865 raft_consensus.cc:359] T fc18e45f08254428bea325a8035ce5cd P d8e942113a444a99add32159e588adcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 } } peers { permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 } }
I20260201 08:59:18.458534 18865 raft_consensus.cc:740] T fc18e45f08254428bea325a8035ce5cd P d8e942113a444a99add32159e588adcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8e942113a444a99add32159e588adcd, State: Initialized, Role: FOLLOWER
I20260201 08:59:18.459038 18865 consensus_queue.cc:260] T fc18e45f08254428bea325a8035ce5cd P d8e942113a444a99add32159e588adcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 } } peers { permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 } }
I20260201 08:59:18.461107 18865 ts_tablet_manager.cc:1434] T fc18e45f08254428bea325a8035ce5cd P d8e942113a444a99add32159e588adcd: Time spent starting tablet: real 0.005s user 0.002s sys 0.005s
I20260201 08:59:18.486475 18612 ts_tablet_manager-itest.cc:368] Electing peer 2...
I20260201 08:59:18.486752 18612 raft_consensus.cc:423] T fc18e45f08254428bea325a8035ce5cd P d8e942113a444a99add32159e588adcd [term 0 FOLLOWER]: Emulating election...
I20260201 08:59:18.486954 18612 raft_consensus.cc:3060] T fc18e45f08254428bea325a8035ce5cd P d8e942113a444a99add32159e588adcd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:18.490500 18612 raft_consensus.cc:697] T fc18e45f08254428bea325a8035ce5cd P d8e942113a444a99add32159e588adcd [term 1 LEADER]: Becoming Leader. State: Replica: d8e942113a444a99add32159e588adcd, State: Running, Role: LEADER
I20260201 08:59:18.491067 18612 consensus_queue.cc:237] T fc18e45f08254428bea325a8035ce5cd P d8e942113a444a99add32159e588adcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 } } peers { permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 } }
I20260201 08:59:18.494372 18612 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260201 08:59:18.501616 18648 catalog_manager.cc:5654] T fc18e45f08254428bea325a8035ce5cd P d8e942113a444a99add32159e588adcd reported cstate change: term changed from 0 to 1, leader changed from <none> to d8e942113a444a99add32159e588adcd (127.18.45.2). New cstate: current_term: 1 leader_uuid: "d8e942113a444a99add32159e588adcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:18.515445 18612 cluster_itest_util.cc:258] Not converged past 0 yet: 0.0 1.1
W20260201 08:59:18.516113 18852 tablet.cc:2378] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260201 08:59:18.619032 18612 cluster_itest_util.cc:258] Not converged past 0 yet: 0.0 1.1
I20260201 08:59:18.822548 18612 cluster_itest_util.cc:258] Not converged past 0 yet: 0.0 1.1
I20260201 08:59:18.964946 18751 raft_consensus.cc:3060] T fc18e45f08254428bea325a8035ce5cd P 9a375cdc88b74c1ab6ca7aa371de2c56 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:18.970518 18869 consensus_queue.cc:1048] T fc18e45f08254428bea325a8035ce5cd P d8e942113a444a99add32159e588adcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:19.126091 18612 ts_tablet_manager-itest.cc:368] Electing peer 3...
I20260201 08:59:19.126374 18612 raft_consensus.cc:423] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [term 0 FOLLOWER]: Emulating election...
I20260201 08:59:19.126634 18612 raft_consensus.cc:3060] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.131944 18612 raft_consensus.cc:697] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [term 1 LEADER]: Becoming Leader. State: Replica: d8e942113a444a99add32159e588adcd, State: Running, Role: LEADER
I20260201 08:59:19.132535 18612 consensus_queue.cc:237] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 } } peers { permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 } }
I20260201 08:59:19.135243 18612 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260201 08:59:19.138945 18612 cluster_itest_util.cc:258] Not converged past 0 yet: 0.0 1.1
I20260201 08:59:19.138724 18648 catalog_manager.cc:5654] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd reported cstate change: term changed from 0 to 1, leader changed from <none> to d8e942113a444a99add32159e588adcd (127.18.45.2). New cstate: current_term: 1 leader_uuid: "d8e942113a444a99add32159e588adcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:19.242616 18612 cluster_itest_util.cc:258] Not converged past 0 yet: 0.0 1.1
I20260201 08:59:19.446174 18612 cluster_itest_util.cc:258] Not converged past 0 yet: 0.0 1.1
I20260201 08:59:19.565053 18751 raft_consensus.cc:3060] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.571781 18878 consensus_queue.cc:1048] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:19.949887 18612 ts_tablet_manager-itest.cc:368] Electing peer 3...
I20260201 08:59:19.950166 18612 raft_consensus.cc:423] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [term 1 LEADER]: Emulating election...
I20260201 08:59:19.950457 18612 raft_consensus.cc:3055] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:19.950677 18612 raft_consensus.cc:740] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8e942113a444a99add32159e588adcd, State: Running, Role: LEADER
I20260201 08:59:19.951151 18612 consensus_queue.cc:260] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 } } peers { permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 } }
I20260201 08:59:19.951848 18612 raft_consensus.cc:3060] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:19.955427 18612 raft_consensus.cc:697] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [term 2 LEADER]: Becoming Leader. State: Replica: d8e942113a444a99add32159e588adcd, State: Running, Role: LEADER
I20260201 08:59:19.956054 18612 consensus_queue.cc:237] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 } } peers { permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 } }
I20260201 08:59:19.957300 18612 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260201 08:59:19.960454 18612 cluster_itest_util.cc:258] Not converged past 0 yet: 1.1 2.2
I20260201 08:59:19.960080 18648 catalog_manager.cc:5654] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "d8e942113a444a99add32159e588adcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:20.063609 18612 cluster_itest_util.cc:258] Not converged past 0 yet: 1.1 2.2
I20260201 08:59:20.266986 18612 cluster_itest_util.cc:258] Not converged past 0 yet: 1.1 2.2
I20260201 08:59:20.530982 18751 raft_consensus.cc:3060] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:20.535387 18751 raft_consensus.cc:1275] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56 [term 2 FOLLOWER]: Refusing update from remote peer d8e942113a444a99add32159e588adcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:20.536311 18887 consensus_queue.cc:1048] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:20.570022 18612 ts_tablet_manager-itest.cc:368] Electing peer 0...
I20260201 08:59:20.570220 18612 raft_consensus.cc:423] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56 [term 2 FOLLOWER]: Emulating election...
I20260201 08:59:20.570413 18612 raft_consensus.cc:3060] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:20.573719 18612 raft_consensus.cc:697] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56 [term 3 LEADER]: Becoming Leader. State: Replica: 9a375cdc88b74c1ab6ca7aa371de2c56, State: Running, Role: LEADER
I20260201 08:59:20.574230 18612 consensus_queue.cc:237] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 } } peers { permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 } }
I20260201 08:59:20.575496 18612 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260201 08:59:20.578419 18612 cluster_itest_util.cc:258] Not converged past 0 yet: 3.3 2.2
I20260201 08:59:20.578673 18648 catalog_manager.cc:5654] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56 reported cstate change: term changed from 2 to 3, leader changed from d8e942113a444a99add32159e588adcd (127.18.45.2) to 9a375cdc88b74c1ab6ca7aa371de2c56 (127.18.45.1). New cstate: current_term: 3 leader_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:20.681367 18612 cluster_itest_util.cc:258] Not converged past 0 yet: 3.3 2.2
I20260201 08:59:20.885169 18612 cluster_itest_util.cc:258] Not converged past 0 yet: 3.3 2.2
I20260201 08:59:20.918438 18751 raft_consensus.cc:1240] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56 [term 3 LEADER]: Rejecting Update request from peer d8e942113a444a99add32159e588adcd for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:20.919572 18894 consensus_queue.cc:1059] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:20.920177 18894 consensus_queue.cc:1243] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [LEADER]: Peer 9a375cdc88b74c1ab6ca7aa371de2c56 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260201 08:59:20.920522 18887 raft_consensus.cc:3055] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:20.920848 18887 raft_consensus.cc:740] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d8e942113a444a99add32159e588adcd, State: Running, Role: LEADER
I20260201 08:59:20.921335 18887 consensus_queue.cc:260] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 } } peers { permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 } }
I20260201 08:59:20.922169 18887 raft_consensus.cc:3060] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:20.977231 18826 raft_consensus.cc:1275] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [term 3 FOLLOWER]: Refusing update from remote peer 9a375cdc88b74c1ab6ca7aa371de2c56: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:20.978289 18893 consensus_queue.cc:1048] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:21.388520 18612 ts_tablet_manager-itest.cc:368] Electing peer 1...
I20260201 08:59:21.388727 18612 raft_consensus.cc:423] T fc18e45f08254428bea325a8035ce5cd P 9a375cdc88b74c1ab6ca7aa371de2c56 [term 1 FOLLOWER]: Emulating election...
I20260201 08:59:21.388912 18612 raft_consensus.cc:3060] T fc18e45f08254428bea325a8035ce5cd P 9a375cdc88b74c1ab6ca7aa371de2c56 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:21.392421 18612 raft_consensus.cc:697] T fc18e45f08254428bea325a8035ce5cd P 9a375cdc88b74c1ab6ca7aa371de2c56 [term 2 LEADER]: Becoming Leader. State: Replica: 9a375cdc88b74c1ab6ca7aa371de2c56, State: Running, Role: LEADER
I20260201 08:59:21.392997 18612 consensus_queue.cc:237] T fc18e45f08254428bea325a8035ce5cd P 9a375cdc88b74c1ab6ca7aa371de2c56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 } } peers { permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 } }
I20260201 08:59:21.394666 18612 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260201 08:59:21.397753 18612 cluster_itest_util.cc:258] Not converged past 0 yet: 2.2 1.1
I20260201 08:59:21.397987 18646 catalog_manager.cc:5654] T fc18e45f08254428bea325a8035ce5cd P 9a375cdc88b74c1ab6ca7aa371de2c56 reported cstate change: term changed from 1 to 2, leader changed from d8e942113a444a99add32159e588adcd (127.18.45.2) to 9a375cdc88b74c1ab6ca7aa371de2c56 (127.18.45.1). New cstate: current_term: 2 leader_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:21.458413 18751 raft_consensus.cc:1240] T fc18e45f08254428bea325a8035ce5cd P 9a375cdc88b74c1ab6ca7aa371de2c56 [term 2 LEADER]: Rejecting Update request from peer d8e942113a444a99add32159e588adcd for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:21.459661 18887 consensus_queue.cc:1059] T fc18e45f08254428bea325a8035ce5cd P d8e942113a444a99add32159e588adcd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:21.460886 18887 consensus_queue.cc:1243] T fc18e45f08254428bea325a8035ce5cd P d8e942113a444a99add32159e588adcd [LEADER]: Peer 9a375cdc88b74c1ab6ca7aa371de2c56 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260201 08:59:21.461360 18907 raft_consensus.cc:3055] T fc18e45f08254428bea325a8035ce5cd P d8e942113a444a99add32159e588adcd [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:21.461597 18907 raft_consensus.cc:740] T fc18e45f08254428bea325a8035ce5cd P d8e942113a444a99add32159e588adcd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8e942113a444a99add32159e588adcd, State: Running, Role: LEADER
I20260201 08:59:21.462085 18907 consensus_queue.cc:260] T fc18e45f08254428bea325a8035ce5cd P d8e942113a444a99add32159e588adcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 } } peers { permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 } }
I20260201 08:59:21.462877 18907 raft_consensus.cc:3060] T fc18e45f08254428bea325a8035ce5cd P d8e942113a444a99add32159e588adcd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:21.500730 18612 cluster_itest_util.cc:258] Not converged past 0 yet: 2.2 1.1
I20260201 08:59:21.704356 18612 cluster_itest_util.cc:258] Not converged past 0 yet: 2.2 1.1
I20260201 08:59:21.776090 18826 raft_consensus.cc:1275] T fc18e45f08254428bea325a8035ce5cd P d8e942113a444a99add32159e588adcd [term 2 FOLLOWER]: Refusing update from remote peer 9a375cdc88b74c1ab6ca7aa371de2c56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:21.777333 18893 consensus_queue.cc:1048] T fc18e45f08254428bea325a8035ce5cd P 9a375cdc88b74c1ab6ca7aa371de2c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:22.007769 18612 ts_tablet_manager-itest.cc:368] Electing peer 3...
I20260201 08:59:22.008019 18612 raft_consensus.cc:423] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [term 3 FOLLOWER]: Emulating election...
I20260201 08:59:22.008247 18612 raft_consensus.cc:3060] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:22.011938 18612 raft_consensus.cc:697] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [term 4 LEADER]: Becoming Leader. State: Replica: d8e942113a444a99add32159e588adcd, State: Running, Role: LEADER
I20260201 08:59:22.012480 18612 consensus_queue.cc:237] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 } } peers { permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 } }
I20260201 08:59:22.014096 18612 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260201 08:59:22.017295 18612 cluster_itest_util.cc:258] Not converged past 0 yet: 3.3 4.4
I20260201 08:59:22.017429 18646 catalog_manager.cc:5654] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd reported cstate change: term changed from 3 to 4, leader changed from 9a375cdc88b74c1ab6ca7aa371de2c56 (127.18.45.1) to d8e942113a444a99add32159e588adcd (127.18.45.2). New cstate: current_term: 4 leader_uuid: "d8e942113a444a99add32159e588adcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:22.120391 18612 cluster_itest_util.cc:258] Not converged past 0 yet: 3.3 4.4
I20260201 08:59:22.287813 18826 raft_consensus.cc:1240] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [term 4 LEADER]: Rejecting Update request from peer 9a375cdc88b74c1ab6ca7aa371de2c56 for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:22.288890 18893 consensus_queue.cc:1059] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:22.289737 18893 consensus_queue.cc:1243] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56 [LEADER]: Peer d8e942113a444a99add32159e588adcd log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260201 08:59:22.290040 18916 raft_consensus.cc:3055] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56 [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:22.290294 18916 raft_consensus.cc:740] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a375cdc88b74c1ab6ca7aa371de2c56, State: Running, Role: LEADER
I20260201 08:59:22.290717 18916 consensus_queue.cc:260] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 } } peers { permanent_uuid: "d8e942113a444a99add32159e588adcd" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38631 } }
I20260201 08:59:22.291373 18916 raft_consensus.cc:3060] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:22.323729 18612 cluster_itest_util.cc:258] Not converged past 0 yet: 3.3 4.4
I20260201 08:59:22.527067 18751 raft_consensus.cc:1275] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56 [term 4 FOLLOWER]: Refusing update from remote peer d8e942113a444a99add32159e588adcd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 08:59:22.528103 18917 consensus_queue.cc:1048] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a375cdc88b74c1ab6ca7aa371de2c56" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:22.830772 18612 tablet_server.cc:178] TabletServer@127.18.45.1:0 shutting down...
I20260201 08:59:22.850092 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 08:59:22.850721 18612 tablet_replica.cc:333] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56: stopping tablet replica
I20260201 08:59:22.851249 18612 raft_consensus.cc:2243] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:22.851675 18612 raft_consensus.cc:2272] T a18c6cc9da4a4af897c2274b4b5e69ba P 9a375cdc88b74c1ab6ca7aa371de2c56 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:22.853706 18612 tablet_replica.cc:333] T fc18e45f08254428bea325a8035ce5cd P 9a375cdc88b74c1ab6ca7aa371de2c56: stopping tablet replica
I20260201 08:59:22.854120 18612 raft_consensus.cc:2243] T fc18e45f08254428bea325a8035ce5cd P 9a375cdc88b74c1ab6ca7aa371de2c56 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:22.854619 18612 raft_consensus.cc:2272] T fc18e45f08254428bea325a8035ce5cd P 9a375cdc88b74c1ab6ca7aa371de2c56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:22.929740 18612 tablet_server.cc:195] TabletServer@127.18.45.1:0 shutdown complete.
I20260201 08:59:22.937561 18612 tablet_server.cc:178] TabletServer@127.18.45.2:0 shutting down...
I20260201 08:59:22.952521 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 08:59:22.953073 18612 tablet_replica.cc:333] T fc18e45f08254428bea325a8035ce5cd P d8e942113a444a99add32159e588adcd: stopping tablet replica
I20260201 08:59:22.953531 18612 raft_consensus.cc:2243] T fc18e45f08254428bea325a8035ce5cd P d8e942113a444a99add32159e588adcd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:22.953912 18612 raft_consensus.cc:2272] T fc18e45f08254428bea325a8035ce5cd P d8e942113a444a99add32159e588adcd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:22.955165 18612 tablet_replica.cc:333] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd: stopping tablet replica
I20260201 08:59:22.955539 18612 raft_consensus.cc:2243] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [term 4 LEADER]: Raft consensus shutting down.
I20260201 08:59:22.956058 18612 raft_consensus.cc:2272] T a18c6cc9da4a4af897c2274b4b5e69ba P d8e942113a444a99add32159e588adcd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:22.963766 18612 tablet_server.cc:195] TabletServer@127.18.45.2:0 shutdown complete.
I20260201 08:59:22.971223 18612 master.cc:561] Master@127.18.45.62:42383 shutting down...
I20260201 08:59:23.125082 18612 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1 [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:23.125574 18612 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:23.125875 18612 tablet_replica.cc:333] T 00000000000000000000000000000000 P 84f6a9ad97c34f5b8dbee0f5e57a5ab1: stopping tablet replica
I20260201 08:59:23.143239 18612 master.cc:583] Master@127.18.45.62:42383 shutdown complete.
[ OK ] LeadershipChangeReportingTest.TestConcurrentGetTableLocations (6832 ms)
[ RUN ] LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange
I20260201 08:59:23.166461 18612 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.45.62:46769
I20260201 08:59:23.167424 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:23.171486 18926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:23.172549 18927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:23.174058 18929 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:23.174245 18612 server_base.cc:1060] running on GCE node
I20260201 08:59:23.175020 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:23.175187 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:23.175340 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936363175328 us; error 0 us; skew 500 ppm
I20260201 08:59:23.175845 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:23.178187 18612 webserver.cc:492] Webserver started at http://127.18.45.62:36853/ using document root <none> and password file <none>
I20260201 08:59:23.178782 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:23.179029 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:23.179303 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:23.180662 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1769936356186478-18612-0/minicluster-data/master-0-root/instance:
uuid: "2557e76fae44466c899df79d708895f2"
format_stamp: "Formatted at 2026-02-01 08:59:23 on dist-test-slave-zz6f"
I20260201 08:59:23.184684 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260201 08:59:23.187651 18934 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:23.188319 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260201 08:59:23.188570 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1769936356186478-18612-0/minicluster-data/master-0-root
uuid: "2557e76fae44466c899df79d708895f2"
format_stamp: "Formatted at 2026-02-01 08:59:23 on dist-test-slave-zz6f"
I20260201 08:59:23.188803 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1769936356186478-18612-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1769936356186478-18612-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1769936356186478-18612-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:23.205965 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:23.206861 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:23.237429 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.62:46769
I20260201 08:59:23.237520 18985 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.62:46769 every 8 connection(s)
I20260201 08:59:23.240515 18986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:23.249296 18986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2: Bootstrap starting.
I20260201 08:59:23.252990 18986 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.256218 18986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2: No bootstrap required, opened a new log
I20260201 08:59:23.257917 18986 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2557e76fae44466c899df79d708895f2" member_type: VOTER }
I20260201 08:59:23.258291 18986 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.258522 18986 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2557e76fae44466c899df79d708895f2, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.259024 18986 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2557e76fae44466c899df79d708895f2" member_type: VOTER }
I20260201 08:59:23.259456 18986 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 08:59:23.259720 18986 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 08:59:23.259975 18986 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:23.263638 18986 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2557e76fae44466c899df79d708895f2" member_type: VOTER }
I20260201 08:59:23.264118 18986 leader_election.cc:304] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2557e76fae44466c899df79d708895f2; no voters:
I20260201 08:59:23.265303 18986 leader_election.cc:290] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 08:59:23.265527 18989 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:23.266785 18989 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2 [term 1 LEADER]: Becoming Leader. State: Replica: 2557e76fae44466c899df79d708895f2, State: Running, Role: LEADER
I20260201 08:59:23.267370 18989 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2557e76fae44466c899df79d708895f2" member_type: VOTER }
I20260201 08:59:23.267963 18986 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260201 08:59:23.269994 18990 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2557e76fae44466c899df79d708895f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2557e76fae44466c899df79d708895f2" member_type: VOTER } }
I20260201 08:59:23.270066 18991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2557e76fae44466c899df79d708895f2. Latest consensus state: current_term: 1 leader_uuid: "2557e76fae44466c899df79d708895f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2557e76fae44466c899df79d708895f2" member_type: VOTER } }
I20260201 08:59:23.270742 18991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2 [sys.catalog]: This master's current role is: LEADER
I20260201 08:59:23.271888 18990 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2 [sys.catalog]: This master's current role is: LEADER
I20260201 08:59:23.273384 18995 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 08:59:23.280871 18995 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 08:59:23.281903 18612 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260201 08:59:23.288173 18995 catalog_manager.cc:1357] Generated new cluster ID: 83c63665e5b04bdaa9464ab212e8fd8a
I20260201 08:59:23.288404 18995 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 08:59:23.308384 18995 catalog_manager.cc:1380] Generated new certificate authority record
I20260201 08:59:23.309355 18995 catalog_manager.cc:1514] Loading token signing keys...
I20260201 08:59:23.320454 18995 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2: Generated new TSK 0
I20260201 08:59:23.320891 18995 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 08:59:23.347512 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:23.352172 19007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:23.353312 19008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:23.354151 19010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:23.354710 18612 server_base.cc:1060] running on GCE node
I20260201 08:59:23.355381 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:23.355566 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:23.355710 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936363355681 us; error 0 us; skew 500 ppm
I20260201 08:59:23.356142 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:23.358006 18612 webserver.cc:492] Webserver started at http://127.18.45.1:38139/ using document root <none> and password file <none>
I20260201 08:59:23.358413 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:23.358592 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:23.358824 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:23.359714 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1769936356186478-18612-0/minicluster-data/ts-0-root/instance:
uuid: "6cfce4cb1c1340deaa2400b9a4f550d3"
format_stamp: "Formatted at 2026-02-01 08:59:23 on dist-test-slave-zz6f"
I20260201 08:59:23.364174 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260201 08:59:23.366974 19015 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:23.367784 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260201 08:59:23.368059 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1769936356186478-18612-0/minicluster-data/ts-0-root
uuid: "6cfce4cb1c1340deaa2400b9a4f550d3"
format_stamp: "Formatted at 2026-02-01 08:59:23 on dist-test-slave-zz6f"
I20260201 08:59:23.368346 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1769936356186478-18612-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1769936356186478-18612-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1769936356186478-18612-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:23.383716 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:23.384546 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:23.385807 18612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:59:23.387761 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:59:23.387971 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:23.388193 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:59:23.388356 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:23.422529 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.1:40291
I20260201 08:59:23.422600 19077 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.1:40291 every 8 connection(s)
I20260201 08:59:23.426837 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:23.433244 19082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:23.434607 19083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:23.436896 18612 server_base.cc:1060] running on GCE node
W20260201 08:59:23.437592 19085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:23.438310 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:23.438481 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:23.438598 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936363438588 us; error 0 us; skew 500 ppm
I20260201 08:59:23.438992 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:23.441143 18612 webserver.cc:492] Webserver started at http://127.18.45.2:40683/ using document root <none> and password file <none>
I20260201 08:59:23.441608 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:23.441879 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:23.442139 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:23.442819 19078 heartbeater.cc:344] Connected to a master server at 127.18.45.62:46769
I20260201 08:59:23.443120 19078 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:23.443114 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1769936356186478-18612-0/minicluster-data/ts-1-root/instance:
uuid: "9f93a958d5264210ba74984700aa745d"
format_stamp: "Formatted at 2026-02-01 08:59:23 on dist-test-slave-zz6f"
I20260201 08:59:23.443819 19078 heartbeater.cc:507] Master 127.18.45.62:46769 requested a full tablet report, sending...
I20260201 08:59:23.445506 18951 ts_manager.cc:194] Registered new tserver with Master: 6cfce4cb1c1340deaa2400b9a4f550d3 (127.18.45.1:40291)
I20260201 08:59:23.446888 18951 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41374
I20260201 08:59:23.447332 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260201 08:59:23.450249 19090 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:23.450835 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260201 08:59:23.451081 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1769936356186478-18612-0/minicluster-data/ts-1-root
uuid: "9f93a958d5264210ba74984700aa745d"
format_stamp: "Formatted at 2026-02-01 08:59:23 on dist-test-slave-zz6f"
I20260201 08:59:23.451313 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1769936356186478-18612-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1769936356186478-18612-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1769936356186478-18612-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:23.465421 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:23.466311 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:23.467517 18612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:59:23.469290 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:59:23.469477 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:23.469672 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:59:23.469813 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:23.503013 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.2:42637
I20260201 08:59:23.503086 19152 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.2:42637 every 8 connection(s)
I20260201 08:59:23.514261 19153 heartbeater.cc:344] Connected to a master server at 127.18.45.62:46769
I20260201 08:59:23.514547 19153 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:23.515097 19153 heartbeater.cc:507] Master 127.18.45.62:46769 requested a full tablet report, sending...
I20260201 08:59:23.516537 18951 ts_manager.cc:194] Registered new tserver with Master: 9f93a958d5264210ba74984700aa745d (127.18.45.2:42637)
I20260201 08:59:23.517589 18612 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.011705433s
I20260201 08:59:23.517604 18951 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41388
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc:422: Skipped
test is skipped; set KUDU_ALLOW_SLOW_TESTS=1 to run
I20260201 08:59:23.534994 18612 tablet_server.cc:178] TabletServer@127.18.45.1:0 shutting down...
I20260201 08:59:23.549137 19078 heartbeater.cc:499] Master 127.18.45.62:46769 was elected leader, sending a full tablet report...
I20260201 08:59:23.551910 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 08:59:23.566187 18612 tablet_server.cc:195] TabletServer@127.18.45.1:0 shutdown complete.
I20260201 08:59:23.571839 18612 tablet_server.cc:178] TabletServer@127.18.45.2:0 shutting down...
I20260201 08:59:23.584960 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 08:59:23.599530 18612 tablet_server.cc:195] TabletServer@127.18.45.2:0 shutdown complete.
I20260201 08:59:23.605170 18612 master.cc:561] Master@127.18.45.62:46769 shutting down...
I20260201 08:59:23.616130 18612 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2 [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:23.616546 18612 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:23.616914 18612 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2557e76fae44466c899df79d708895f2: stopping tablet replica
I20260201 08:59:23.634305 18612 master.cc:583] Master@127.18.45.62:46769 shutdown complete.
[ SKIPPED ] LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange (487 ms)
[ RUN ] LeadershipChangeReportingTest.TestUpdatedConsensusState
I20260201 08:59:23.654613 18612 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.45.62:42775
I20260201 08:59:23.655655 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:23.659780 19166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:23.661088 19167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:23.662158 19169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:23.662791 18612 server_base.cc:1060] running on GCE node
I20260201 08:59:23.663589 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:23.663758 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:23.663935 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936363663906 us; error 0 us; skew 500 ppm
I20260201 08:59:23.664397 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:23.666322 18612 webserver.cc:492] Webserver started at http://127.18.45.62:40913/ using document root <none> and password file <none>
I20260201 08:59:23.666769 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:23.666965 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:23.667229 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:23.668181 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1769936356186478-18612-0/minicluster-data/master-0-root/instance:
uuid: "e29449fbd1434bd197e0252eb8312fe6"
format_stamp: "Formatted at 2026-02-01 08:59:23 on dist-test-slave-zz6f"
I20260201 08:59:23.671795 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260201 08:59:23.674523 19174 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:23.675180 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260201 08:59:23.675454 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1769936356186478-18612-0/minicluster-data/master-0-root
uuid: "e29449fbd1434bd197e0252eb8312fe6"
format_stamp: "Formatted at 2026-02-01 08:59:23 on dist-test-slave-zz6f"
I20260201 08:59:23.675709 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1769936356186478-18612-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1769936356186478-18612-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1769936356186478-18612-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:23.687661 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:23.688531 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:23.719112 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.62:42775
I20260201 08:59:23.719233 19225 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.62:42775 every 8 connection(s)
I20260201 08:59:23.722839 19226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:23.731348 19226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6: Bootstrap starting.
I20260201 08:59:23.735040 19226 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.738443 19226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6: No bootstrap required, opened a new log
I20260201 08:59:23.740061 19226 raft_consensus.cc:359] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e29449fbd1434bd197e0252eb8312fe6" member_type: VOTER }
I20260201 08:59:23.740442 19226 raft_consensus.cc:385] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.740630 19226 raft_consensus.cc:740] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29449fbd1434bd197e0252eb8312fe6, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.741107 19226 consensus_queue.cc:260] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e29449fbd1434bd197e0252eb8312fe6" member_type: VOTER }
I20260201 08:59:23.741480 19226 raft_consensus.cc:399] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 08:59:23.741652 19226 raft_consensus.cc:493] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 08:59:23.741847 19226 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:23.745448 19226 raft_consensus.cc:515] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e29449fbd1434bd197e0252eb8312fe6" member_type: VOTER }
I20260201 08:59:23.745875 19226 leader_election.cc:304] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e29449fbd1434bd197e0252eb8312fe6; no voters:
I20260201 08:59:23.746831 19226 leader_election.cc:290] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 08:59:23.747084 19229 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:23.748323 19229 raft_consensus.cc:697] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6 [term 1 LEADER]: Becoming Leader. State: Replica: e29449fbd1434bd197e0252eb8312fe6, State: Running, Role: LEADER
I20260201 08:59:23.749015 19229 consensus_queue.cc:237] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e29449fbd1434bd197e0252eb8312fe6" member_type: VOTER }
I20260201 08:59:23.749557 19226 sys_catalog.cc:565] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6 [sys.catalog]: configured and running, proceeding with master startup.
I20260201 08:59:23.751597 19230 sys_catalog.cc:455] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e29449fbd1434bd197e0252eb8312fe6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e29449fbd1434bd197e0252eb8312fe6" member_type: VOTER } }
I20260201 08:59:23.751631 19231 sys_catalog.cc:455] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e29449fbd1434bd197e0252eb8312fe6. Latest consensus state: current_term: 1 leader_uuid: "e29449fbd1434bd197e0252eb8312fe6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e29449fbd1434bd197e0252eb8312fe6" member_type: VOTER } }
I20260201 08:59:23.752327 19231 sys_catalog.cc:458] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6 [sys.catalog]: This master's current role is: LEADER
I20260201 08:59:23.752300 19230 sys_catalog.cc:458] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6 [sys.catalog]: This master's current role is: LEADER
I20260201 08:59:23.759065 19235 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 08:59:23.764246 19235 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 08:59:23.765156 18612 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260201 08:59:23.771373 19235 catalog_manager.cc:1357] Generated new cluster ID: 58907d8d77e24561be03e51476349d03
I20260201 08:59:23.771620 19235 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 08:59:23.789326 19235 catalog_manager.cc:1380] Generated new certificate authority record
I20260201 08:59:23.790350 19235 catalog_manager.cc:1514] Loading token signing keys...
I20260201 08:59:23.807677 19235 catalog_manager.cc:6027] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6: Generated new TSK 0
I20260201 08:59:23.808179 19235 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 08:59:23.830840 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:23.836105 19247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:23.837241 19248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:23.838523 19250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:23.839152 18612 server_base.cc:1060] running on GCE node
I20260201 08:59:23.839816 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:23.840034 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:23.840221 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936363840180 us; error 0 us; skew 500 ppm
I20260201 08:59:23.840726 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:23.842773 18612 webserver.cc:492] Webserver started at http://127.18.45.1:36481/ using document root <none> and password file <none>
I20260201 08:59:23.843174 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:23.843353 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:23.843585 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:23.844553 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1769936356186478-18612-0/minicluster-data/ts-0-root/instance:
uuid: "ea66735cb38642aca20221d9698c2a45"
format_stamp: "Formatted at 2026-02-01 08:59:23 on dist-test-slave-zz6f"
I20260201 08:59:23.848295 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260201 08:59:23.851181 19255 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:23.851879 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260201 08:59:23.852140 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1769936356186478-18612-0/minicluster-data/ts-0-root
uuid: "ea66735cb38642aca20221d9698c2a45"
format_stamp: "Formatted at 2026-02-01 08:59:23 on dist-test-slave-zz6f"
I20260201 08:59:23.852473 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1769936356186478-18612-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1769936356186478-18612-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1769936356186478-18612-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:23.891937 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:23.892972 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:23.894189 18612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:59:23.896186 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:59:23.896389 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:23.896608 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:59:23.896755 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:23.929777 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.1:35925
I20260201 08:59:23.929867 19317 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.1:35925 every 8 connection(s)
I20260201 08:59:23.933929 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:23.940778 19322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:23.942974 19323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:23.944449 18612 server_base.cc:1060] running on GCE node
W20260201 08:59:23.945361 19325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:23.945688 19318 heartbeater.cc:344] Connected to a master server at 127.18.45.62:42775
I20260201 08:59:23.946045 19318 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:23.946311 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:23.946537 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:23.946693 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936363946663 us; error 0 us; skew 500 ppm
I20260201 08:59:23.946768 19318 heartbeater.cc:507] Master 127.18.45.62:42775 requested a full tablet report, sending...
I20260201 08:59:23.947275 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:23.948797 19191 ts_manager.cc:194] Registered new tserver with Master: ea66735cb38642aca20221d9698c2a45 (127.18.45.1:35925)
I20260201 08:59:23.949647 18612 webserver.cc:492] Webserver started at http://127.18.45.2:34395/ using document root <none> and password file <none>
I20260201 08:59:23.950084 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:23.950269 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:23.950595 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:23.950642 19191 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51676
I20260201 08:59:23.951887 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1769936356186478-18612-0/minicluster-data/ts-1-root/instance:
uuid: "d4f35f1fce154dc584cb0456a6ba96ab"
format_stamp: "Formatted at 2026-02-01 08:59:23 on dist-test-slave-zz6f"
I20260201 08:59:23.955857 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260201 08:59:23.958699 19330 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:23.959374 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260201 08:59:23.959635 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1769936356186478-18612-0/minicluster-data/ts-1-root
uuid: "d4f35f1fce154dc584cb0456a6ba96ab"
format_stamp: "Formatted at 2026-02-01 08:59:23 on dist-test-slave-zz6f"
I20260201 08:59:23.959887 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1769936356186478-18612-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1769936356186478-18612-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1769936356186478-18612-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:23.978240 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:23.979060 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:23.980249 18612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:59:23.982178 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:59:23.982379 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:23.982596 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:59:23.982774 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:24.015995 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.2:45993
I20260201 08:59:24.016077 19392 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.2:45993 every 8 connection(s)
I20260201 08:59:24.028188 19393 heartbeater.cc:344] Connected to a master server at 127.18.45.62:42775
I20260201 08:59:24.028520 19393 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:24.029201 19393 heartbeater.cc:507] Master 127.18.45.62:42775 requested a full tablet report, sending...
I20260201 08:59:24.030843 19191 ts_manager.cc:194] Registered new tserver with Master: d4f35f1fce154dc584cb0456a6ba96ab (127.18.45.2:45993)
I20260201 08:59:24.031564 18612 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.012787775s
I20260201 08:59:24.032032 19191 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51678
I20260201 08:59:24.049903 19191 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51692:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260201 08:59:24.051255 19191 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 3 tablet servers would be needed, 2 are available. Consider bringing up more tablet servers.
I20260201 08:59:24.052861 19318 heartbeater.cc:499] Master 127.18.45.62:42775 was elected leader, sending a full tablet report...
I20260201 08:59:24.090505 19358 tablet_service.cc:1505] Processing CreateTablet for tablet 08e8da2c0dc54d9fa2b306bd8a31df59 (DEFAULT_TABLE table=test-table [id=f42a785b1f7c45db8864948f02924e10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260201 08:59:24.091462 19358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e8da2c0dc54d9fa2b306bd8a31df59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:24.091516 19283 tablet_service.cc:1505] Processing CreateTablet for tablet 08e8da2c0dc54d9fa2b306bd8a31df59 (DEFAULT_TABLE table=test-table [id=f42a785b1f7c45db8864948f02924e10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260201 08:59:24.092453 19283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e8da2c0dc54d9fa2b306bd8a31df59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:24.102072 19406 tablet_bootstrap.cc:492] T 08e8da2c0dc54d9fa2b306bd8a31df59 P d4f35f1fce154dc584cb0456a6ba96ab: Bootstrap starting.
I20260201 08:59:24.102434 19407 tablet_bootstrap.cc:492] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45: Bootstrap starting.
I20260201 08:59:24.106750 19406 tablet_bootstrap.cc:654] T 08e8da2c0dc54d9fa2b306bd8a31df59 P d4f35f1fce154dc584cb0456a6ba96ab: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:24.107004 19407 tablet_bootstrap.cc:654] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:24.110415 19406 tablet_bootstrap.cc:492] T 08e8da2c0dc54d9fa2b306bd8a31df59 P d4f35f1fce154dc584cb0456a6ba96ab: No bootstrap required, opened a new log
I20260201 08:59:24.110457 19407 tablet_bootstrap.cc:492] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45: No bootstrap required, opened a new log
I20260201 08:59:24.110818 19406 ts_tablet_manager.cc:1403] T 08e8da2c0dc54d9fa2b306bd8a31df59 P d4f35f1fce154dc584cb0456a6ba96ab: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260201 08:59:24.110877 19407 ts_tablet_manager.cc:1403] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260201 08:59:24.112505 19406 raft_consensus.cc:359] T 08e8da2c0dc54d9fa2b306bd8a31df59 P d4f35f1fce154dc584cb0456a6ba96ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4f35f1fce154dc584cb0456a6ba96ab" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 45993 } } peers { permanent_uuid: "ea66735cb38642aca20221d9698c2a45" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 35925 } }
I20260201 08:59:24.112660 19407 raft_consensus.cc:359] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4f35f1fce154dc584cb0456a6ba96ab" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 45993 } } peers { permanent_uuid: "ea66735cb38642aca20221d9698c2a45" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 35925 } }
I20260201 08:59:24.113119 19406 raft_consensus.cc:740] T 08e8da2c0dc54d9fa2b306bd8a31df59 P d4f35f1fce154dc584cb0456a6ba96ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4f35f1fce154dc584cb0456a6ba96ab, State: Initialized, Role: FOLLOWER
I20260201 08:59:24.113245 19407 raft_consensus.cc:740] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea66735cb38642aca20221d9698c2a45, State: Initialized, Role: FOLLOWER
I20260201 08:59:24.113711 19406 consensus_queue.cc:260] T 08e8da2c0dc54d9fa2b306bd8a31df59 P d4f35f1fce154dc584cb0456a6ba96ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4f35f1fce154dc584cb0456a6ba96ab" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 45993 } } peers { permanent_uuid: "ea66735cb38642aca20221d9698c2a45" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 35925 } }
I20260201 08:59:24.113830 19407 consensus_queue.cc:260] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4f35f1fce154dc584cb0456a6ba96ab" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 45993 } } peers { permanent_uuid: "ea66735cb38642aca20221d9698c2a45" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 35925 } }
I20260201 08:59:24.116200 19393 heartbeater.cc:499] Master 127.18.45.62:42775 was elected leader, sending a full tablet report...
I20260201 08:59:24.116415 19406 ts_tablet_manager.cc:1434] T 08e8da2c0dc54d9fa2b306bd8a31df59 P d4f35f1fce154dc584cb0456a6ba96ab: Time spent starting tablet: real 0.005s user 0.001s sys 0.004s
I20260201 08:59:24.117146 19407 ts_tablet_manager.cc:1434] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260201 08:59:24.141216 18612 ts_tablet_manager-itest.cc:368] Electing peer 0...
I20260201 08:59:24.141423 18612 raft_consensus.cc:423] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [term 0 FOLLOWER]: Emulating election...
I20260201 08:59:24.141646 18612 raft_consensus.cc:3060] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.145468 18612 raft_consensus.cc:697] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [term 1 LEADER]: Becoming Leader. State: Replica: ea66735cb38642aca20221d9698c2a45, State: Running, Role: LEADER
W20260201 08:59:24.145772 19318 heartbeater.cc:646] Failed to heartbeat to 127.18.45.62:42775 (0 consecutive failures): IO error: failing all heartbeats for tests
I20260201 08:59:24.146083 18612 consensus_queue.cc:237] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4f35f1fce154dc584cb0456a6ba96ab" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 45993 } } peers { permanent_uuid: "ea66735cb38642aca20221d9698c2a45" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 35925 } }
I20260201 08:59:24.148489 18612 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260201 08:59:24.164861 18612 cluster_itest_util.cc:258] Not converged past 1 yet: 1.1 0.0
I20260201 08:59:24.268383 18612 cluster_itest_util.cc:258] Not converged past 1 yet: 1.1 0.0
I20260201 08:59:24.471767 18612 cluster_itest_util.cc:258] Not converged past 1 yet: 1.1 0.0
I20260201 08:59:24.613873 19368 raft_consensus.cc:3060] T 08e8da2c0dc54d9fa2b306bd8a31df59 P d4f35f1fce154dc584cb0456a6ba96ab [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.619481 19411 consensus_queue.cc:1048] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4f35f1fce154dc584cb0456a6ba96ab" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 45993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:24.776294 18612 ts_tablet_manager-itest.cc:368] Electing peer 0...
I20260201 08:59:24.776654 18612 raft_consensus.cc:423] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [term 1 LEADER]: Emulating election...
I20260201 08:59:24.776916 18612 raft_consensus.cc:3055] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:24.777112 18612 raft_consensus.cc:740] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea66735cb38642aca20221d9698c2a45, State: Running, Role: LEADER
I20260201 08:59:24.777578 18612 consensus_queue.cc:260] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4f35f1fce154dc584cb0456a6ba96ab" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 45993 } } peers { permanent_uuid: "ea66735cb38642aca20221d9698c2a45" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 35925 } }
I20260201 08:59:24.778162 18612 raft_consensus.cc:3060] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:24.781800 18612 raft_consensus.cc:697] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [term 2 LEADER]: Becoming Leader. State: Replica: ea66735cb38642aca20221d9698c2a45, State: Running, Role: LEADER
I20260201 08:59:24.782321 18612 consensus_queue.cc:237] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4f35f1fce154dc584cb0456a6ba96ab" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 45993 } } peers { permanent_uuid: "ea66735cb38642aca20221d9698c2a45" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 35925 } }
I20260201 08:59:24.783378 18612 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260201 08:59:24.786602 18612 cluster_itest_util.cc:258] Not converged past 2 yet: 2.2 1.1
I20260201 08:59:24.890370 18612 cluster_itest_util.cc:258] Not converged past 2 yet: 2.2 1.1
I20260201 08:59:25.094154 18612 cluster_itest_util.cc:258] Not converged past 2 yet: 2.2 1.1
I20260201 08:59:25.239017 19368 raft_consensus.cc:3060] T 08e8da2c0dc54d9fa2b306bd8a31df59 P d4f35f1fce154dc584cb0456a6ba96ab [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:25.243366 19368 raft_consensus.cc:1275] T 08e8da2c0dc54d9fa2b306bd8a31df59 P d4f35f1fce154dc584cb0456a6ba96ab [term 2 FOLLOWER]: Refusing update from remote peer ea66735cb38642aca20221d9698c2a45: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:25.244407 19411 consensus_queue.cc:1048] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4f35f1fce154dc584cb0456a6ba96ab" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 45993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:25.399124 18612 ts_tablet_manager-itest.cc:368] Electing peer 0...
I20260201 08:59:25.399415 18612 raft_consensus.cc:423] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [term 2 LEADER]: Emulating election...
I20260201 08:59:25.399647 18612 raft_consensus.cc:3055] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:25.399847 18612 raft_consensus.cc:740] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ea66735cb38642aca20221d9698c2a45, State: Running, Role: LEADER
I20260201 08:59:25.400300 18612 consensus_queue.cc:260] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4f35f1fce154dc584cb0456a6ba96ab" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 45993 } } peers { permanent_uuid: "ea66735cb38642aca20221d9698c2a45" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 35925 } }
I20260201 08:59:25.400931 18612 raft_consensus.cc:3060] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:25.404714 18612 raft_consensus.cc:697] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [term 3 LEADER]: Becoming Leader. State: Replica: ea66735cb38642aca20221d9698c2a45, State: Running, Role: LEADER
I20260201 08:59:25.405260 18612 consensus_queue.cc:237] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4f35f1fce154dc584cb0456a6ba96ab" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 45993 } } peers { permanent_uuid: "ea66735cb38642aca20221d9698c2a45" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 35925 } }
I20260201 08:59:25.406406 18612 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260201 08:59:25.409802 18612 cluster_itest_util.cc:258] Not converged past 3 yet: 3.3 2.2
I20260201 08:59:25.513724 18612 cluster_itest_util.cc:258] Not converged past 3 yet: 3.3 2.2
I20260201 08:59:25.717664 18612 cluster_itest_util.cc:258] Not converged past 3 yet: 3.3 2.2
I20260201 08:59:25.877143 19368 raft_consensus.cc:3060] T 08e8da2c0dc54d9fa2b306bd8a31df59 P d4f35f1fce154dc584cb0456a6ba96ab [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:25.881469 19368 raft_consensus.cc:1275] T 08e8da2c0dc54d9fa2b306bd8a31df59 P d4f35f1fce154dc584cb0456a6ba96ab [term 3 FOLLOWER]: Refusing update from remote peer ea66735cb38642aca20221d9698c2a45: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:25.882582 19421 consensus_queue.cc:1048] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4f35f1fce154dc584cb0456a6ba96ab" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 45993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:26.023504 18612 tablet_server.cc:178] TabletServer@127.18.45.1:0 shutting down...
I20260201 08:59:26.041134 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 08:59:26.041692 18612 tablet_replica.cc:333] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45: stopping tablet replica
I20260201 08:59:26.042137 18612 raft_consensus.cc:2243] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [term 3 LEADER]: Raft consensus shutting down.
I20260201 08:59:26.042711 18612 raft_consensus.cc:2272] T 08e8da2c0dc54d9fa2b306bd8a31df59 P ea66735cb38642aca20221d9698c2a45 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:26.051723 18612 tablet_server.cc:195] TabletServer@127.18.45.1:0 shutdown complete.
I20260201 08:59:26.058789 18612 tablet_server.cc:178] TabletServer@127.18.45.2:0 shutting down...
I20260201 08:59:26.071924 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 08:59:26.072479 18612 tablet_replica.cc:333] T 08e8da2c0dc54d9fa2b306bd8a31df59 P d4f35f1fce154dc584cb0456a6ba96ab: stopping tablet replica
I20260201 08:59:26.072964 18612 raft_consensus.cc:2243] T 08e8da2c0dc54d9fa2b306bd8a31df59 P d4f35f1fce154dc584cb0456a6ba96ab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:26.073364 18612 raft_consensus.cc:2272] T 08e8da2c0dc54d9fa2b306bd8a31df59 P d4f35f1fce154dc584cb0456a6ba96ab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:26.090955 18612 tablet_server.cc:195] TabletServer@127.18.45.2:0 shutdown complete.
I20260201 08:59:26.097570 18612 master.cc:561] Master@127.18.45.62:42775 shutting down...
I20260201 08:59:26.109669 18612 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6 [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:26.110141 18612 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:26.110424 18612 tablet_replica.cc:333] T 00000000000000000000000000000000 P e29449fbd1434bd197e0252eb8312fe6: stopping tablet replica
I20260201 08:59:26.126042 18612 master.cc:583] Master@127.18.45.62:42775 shutdown complete.
[ OK ] LeadershipChangeReportingTest.TestUpdatedConsensusState (2492 ms)
[----------] 3 tests from LeadershipChangeReportingTest (9813 ms total)
[----------] 4 tests from TsTabletManagerITest
[ RUN ] TsTabletManagerITest.ReportOnReplicaHealthStatus
I20260201 08:59:26.146934 18612 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.45.62:36319
I20260201 08:59:26.147908 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:26.152208 19432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:26.153285 19433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:26.154384 18612 server_base.cc:1060] running on GCE node
W20260201 08:59:26.154721 19435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:26.155489 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:26.155655 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:26.155830 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936366155801 us; error 0 us; skew 500 ppm
I20260201 08:59:26.156308 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:26.158378 18612 webserver.cc:492] Webserver started at http://127.18.45.62:34965/ using document root <none> and password file <none>
I20260201 08:59:26.158834 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:26.159013 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:26.159279 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:26.160331 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1769936356186478-18612-0/minicluster-data/master-0-root/instance:
uuid: "3168268d35a2471d889a2edfade13125"
format_stamp: "Formatted at 2026-02-01 08:59:26 on dist-test-slave-zz6f"
I20260201 08:59:26.164299 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.001s sys 0.002s
I20260201 08:59:26.167346 19440 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:26.167979 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260201 08:59:26.168234 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1769936356186478-18612-0/minicluster-data/master-0-root
uuid: "3168268d35a2471d889a2edfade13125"
format_stamp: "Formatted at 2026-02-01 08:59:26 on dist-test-slave-zz6f"
I20260201 08:59:26.168473 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1769936356186478-18612-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1769936356186478-18612-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1769936356186478-18612-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:26.182783 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:26.183750 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:26.216511 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.62:36319
I20260201 08:59:26.216619 19491 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.62:36319 every 8 connection(s)
I20260201 08:59:26.220158 19492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:26.228917 19492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125: Bootstrap starting.
I20260201 08:59:26.232483 19492 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:26.235690 19492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125: No bootstrap required, opened a new log
I20260201 08:59:26.237257 19492 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3168268d35a2471d889a2edfade13125" member_type: VOTER }
I20260201 08:59:26.237596 19492 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:26.237756 19492 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3168268d35a2471d889a2edfade13125, State: Initialized, Role: FOLLOWER
I20260201 08:59:26.238129 19492 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3168268d35a2471d889a2edfade13125" member_type: VOTER }
I20260201 08:59:26.238468 19492 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 08:59:26.238670 19492 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 08:59:26.238884 19492 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:26.242789 19492 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3168268d35a2471d889a2edfade13125" member_type: VOTER }
I20260201 08:59:26.243162 19492 leader_election.cc:304] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3168268d35a2471d889a2edfade13125; no voters:
I20260201 08:59:26.244081 19492 leader_election.cc:290] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 08:59:26.244341 19495 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:26.245759 19495 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125 [term 1 LEADER]: Becoming Leader. State: Replica: 3168268d35a2471d889a2edfade13125, State: Running, Role: LEADER
I20260201 08:59:26.246356 19495 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3168268d35a2471d889a2edfade13125" member_type: VOTER }
I20260201 08:59:26.246940 19492 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125 [sys.catalog]: configured and running, proceeding with master startup.
I20260201 08:59:26.248867 19496 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3168268d35a2471d889a2edfade13125" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3168268d35a2471d889a2edfade13125" member_type: VOTER } }
I20260201 08:59:26.248907 19497 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3168268d35a2471d889a2edfade13125. Latest consensus state: current_term: 1 leader_uuid: "3168268d35a2471d889a2edfade13125" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3168268d35a2471d889a2edfade13125" member_type: VOTER } }
I20260201 08:59:26.249567 19497 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125 [sys.catalog]: This master's current role is: LEADER
I20260201 08:59:26.249526 19496 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125 [sys.catalog]: This master's current role is: LEADER
I20260201 08:59:26.252043 19501 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 08:59:26.259105 19501 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 08:59:26.260005 18612 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260201 08:59:26.266196 19501 catalog_manager.cc:1357] Generated new cluster ID: de1af2dda65443fea7f96446112fa005
I20260201 08:59:26.266383 19501 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 08:59:26.288969 19501 catalog_manager.cc:1380] Generated new certificate authority record
I20260201 08:59:26.290001 19501 catalog_manager.cc:1514] Loading token signing keys...
I20260201 08:59:26.303843 19501 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125: Generated new TSK 0
I20260201 08:59:26.304327 19501 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 08:59:26.325663 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:26.330436 19513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:26.331419 19514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:26.332564 19516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:26.332873 18612 server_base.cc:1060] running on GCE node
I20260201 08:59:26.333631 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:26.333783 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:26.333890 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936366333879 us; error 0 us; skew 500 ppm
I20260201 08:59:26.334335 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:26.336207 18612 webserver.cc:492] Webserver started at http://127.18.45.1:39045/ using document root <none> and password file <none>
I20260201 08:59:26.336606 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:26.336741 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:26.336977 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:26.337859 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1769936356186478-18612-0/minicluster-data/ts-0-root/instance:
uuid: "d5d0fd319e26453ca466d5fa85b90145"
format_stamp: "Formatted at 2026-02-01 08:59:26 on dist-test-slave-zz6f"
I20260201 08:59:26.356698 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.018s user 0.002s sys 0.004s
I20260201 08:59:26.360350 19522 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:26.361088 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260201 08:59:26.361322 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1769936356186478-18612-0/minicluster-data/ts-0-root
uuid: "d5d0fd319e26453ca466d5fa85b90145"
format_stamp: "Formatted at 2026-02-01 08:59:26 on dist-test-slave-zz6f"
I20260201 08:59:26.361662 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1769936356186478-18612-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1769936356186478-18612-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1769936356186478-18612-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:26.375777 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:26.376933 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:26.378293 18612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:59:26.380345 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:59:26.380525 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:26.380710 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:59:26.380895 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260201 08:59:26.417362 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.1:40291
I20260201 08:59:26.417438 19584 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.1:40291 every 8 connection(s)
I20260201 08:59:26.422569 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:26.430019 19590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:26.431133 19589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:26.435526 19592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:26.435978 18612 server_base.cc:1060] running on GCE node
I20260201 08:59:26.437000 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:26.437285 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:26.437493 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936366437477 us; error 0 us; skew 500 ppm
I20260201 08:59:26.438023 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:26.440766 18612 webserver.cc:492] Webserver started at http://127.18.45.2:39299/ using document root <none> and password file <none>
I20260201 08:59:26.440848 19585 heartbeater.cc:344] Connected to a master server at 127.18.45.62:36319
I20260201 08:59:26.441217 19585 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:26.441414 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:26.441653 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:26.441954 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:26.441962 19585 heartbeater.cc:507] Master 127.18.45.62:36319 requested a full tablet report, sending...
I20260201 08:59:26.443401 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1769936356186478-18612-0/minicluster-data/ts-1-root/instance:
uuid: "3989928a62444b81ac63e00b9e7db901"
format_stamp: "Formatted at 2026-02-01 08:59:26 on dist-test-slave-zz6f"
I20260201 08:59:26.444128 19457 ts_manager.cc:194] Registered new tserver with Master: d5d0fd319e26453ca466d5fa85b90145 (127.18.45.1:40291)
I20260201 08:59:26.445926 19457 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43472
I20260201 08:59:26.447927 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260201 08:59:26.451048 19597 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:26.451857 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260201 08:59:26.452059 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1769936356186478-18612-0/minicluster-data/ts-1-root
uuid: "3989928a62444b81ac63e00b9e7db901"
format_stamp: "Formatted at 2026-02-01 08:59:26 on dist-test-slave-zz6f"
I20260201 08:59:26.452256 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1769936356186478-18612-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1769936356186478-18612-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1769936356186478-18612-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:26.466866 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:26.467773 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:26.468963 18612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:59:26.470965 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:59:26.471144 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:26.471356 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:59:26.471498 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:26.507229 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.2:46185
I20260201 08:59:26.507337 19659 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.2:46185 every 8 connection(s)
I20260201 08:59:26.511521 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:26.517436 19663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:26.518594 19664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:26.521042 19660 heartbeater.cc:344] Connected to a master server at 127.18.45.62:36319
I20260201 08:59:26.521531 19660 heartbeater.cc:461] Registering TS with master...
W20260201 08:59:26.522029 19666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:26.522204 18612 server_base.cc:1060] running on GCE node
I20260201 08:59:26.522595 19660 heartbeater.cc:507] Master 127.18.45.62:36319 requested a full tablet report, sending...
I20260201 08:59:26.523132 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:26.523356 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:26.523546 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936366523528 us; error 0 us; skew 500 ppm
I20260201 08:59:26.524209 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:26.524488 19457 ts_manager.cc:194] Registered new tserver with Master: 3989928a62444b81ac63e00b9e7db901 (127.18.45.2:46185)
I20260201 08:59:26.525784 19457 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43484
I20260201 08:59:26.526613 18612 webserver.cc:492] Webserver started at http://127.18.45.3:43643/ using document root <none> and password file <none>
I20260201 08:59:26.527051 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:26.527221 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:26.527505 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:26.528491 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1769936356186478-18612-0/minicluster-data/ts-2-root/instance:
uuid: "04a063ff13154f6383ecc7921667310d"
format_stamp: "Formatted at 2026-02-01 08:59:26 on dist-test-slave-zz6f"
I20260201 08:59:26.532322 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260201 08:59:26.535159 19671 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:26.535836 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260201 08:59:26.536087 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1769936356186478-18612-0/minicluster-data/ts-2-root
uuid: "04a063ff13154f6383ecc7921667310d"
format_stamp: "Formatted at 2026-02-01 08:59:26 on dist-test-slave-zz6f"
I20260201 08:59:26.536340 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1769936356186478-18612-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1769936356186478-18612-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1769936356186478-18612-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:26.562183 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:26.563266 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:26.564565 18612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:59:26.566583 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:59:26.566784 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:26.566995 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:59:26.567157 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:26.629413 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.3:38947
I20260201 08:59:26.629484 19733 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.3:38947 every 8 connection(s)
I20260201 08:59:26.642668 19734 heartbeater.cc:344] Connected to a master server at 127.18.45.62:36319
I20260201 08:59:26.642977 19734 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:26.643724 19734 heartbeater.cc:507] Master 127.18.45.62:36319 requested a full tablet report, sending...
I20260201 08:59:26.645483 19457 ts_manager.cc:194] Registered new tserver with Master: 04a063ff13154f6383ecc7921667310d (127.18.45.3:38947)
I20260201 08:59:26.645766 18612 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.012234297s
I20260201 08:59:26.646663 19457 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43498
I20260201 08:59:26.669013 19457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43504:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
}
}
W20260201 08:59:26.670711 19457 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260201 08:59:26.710417 19699 tablet_service.cc:1505] Processing CreateTablet for tablet c84b622a7fc249329310f0c08f20a9f0 (DEFAULT_TABLE table=test-table [id=1259fce432bf431f98440fdd57865043]), partition=
I20260201 08:59:26.711673 19699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c84b622a7fc249329310f0c08f20a9f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:26.711922 19625 tablet_service.cc:1505] Processing CreateTablet for tablet c84b622a7fc249329310f0c08f20a9f0 (DEFAULT_TABLE table=test-table [id=1259fce432bf431f98440fdd57865043]), partition=
I20260201 08:59:26.712837 19625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c84b622a7fc249329310f0c08f20a9f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:26.717049 19550 tablet_service.cc:1505] Processing CreateTablet for tablet c84b622a7fc249329310f0c08f20a9f0 (DEFAULT_TABLE table=test-table [id=1259fce432bf431f98440fdd57865043]), partition=
I20260201 08:59:26.717927 19550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c84b622a7fc249329310f0c08f20a9f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:26.729624 19749 tablet_bootstrap.cc:492] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d: Bootstrap starting.
I20260201 08:59:26.736370 19750 tablet_bootstrap.cc:492] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901: Bootstrap starting.
I20260201 08:59:26.737715 19751 tablet_bootstrap.cc:492] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145: Bootstrap starting.
I20260201 08:59:26.738585 19749 tablet_bootstrap.cc:654] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:26.743563 19751 tablet_bootstrap.cc:654] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:26.744006 19750 tablet_bootstrap.cc:654] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:26.745945 19749 tablet_bootstrap.cc:492] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d: No bootstrap required, opened a new log
I20260201 08:59:26.746416 19749 ts_tablet_manager.cc:1403] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d: Time spent bootstrapping tablet: real 0.017s user 0.012s sys 0.004s
I20260201 08:59:26.750300 19750 tablet_bootstrap.cc:492] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901: No bootstrap required, opened a new log
I20260201 08:59:26.750910 19750 ts_tablet_manager.cc:1403] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.004s
I20260201 08:59:26.751308 19751 tablet_bootstrap.cc:492] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145: No bootstrap required, opened a new log
I20260201 08:59:26.749766 19749 raft_consensus.cc:359] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3989928a62444b81ac63e00b9e7db901" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 46185 } } peers { permanent_uuid: "04a063ff13154f6383ecc7921667310d" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38947 } } peers { permanent_uuid: "d5d0fd319e26453ca466d5fa85b90145" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 40291 } }
I20260201 08:59:26.751698 19749 raft_consensus.cc:385] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:26.751798 19751 ts_tablet_manager.cc:1403] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.007s
I20260201 08:59:26.752048 19749 raft_consensus.cc:740] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04a063ff13154f6383ecc7921667310d, State: Initialized, Role: FOLLOWER
I20260201 08:59:26.752871 19749 consensus_queue.cc:260] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3989928a62444b81ac63e00b9e7db901" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 46185 } } peers { permanent_uuid: "04a063ff13154f6383ecc7921667310d" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38947 } } peers { permanent_uuid: "d5d0fd319e26453ca466d5fa85b90145" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 40291 } }
I20260201 08:59:26.753602 19750 raft_consensus.cc:359] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3989928a62444b81ac63e00b9e7db901" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 46185 } } peers { permanent_uuid: "04a063ff13154f6383ecc7921667310d" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38947 } } peers { permanent_uuid: "d5d0fd319e26453ca466d5fa85b90145" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 40291 } }
I20260201 08:59:26.754436 19750 raft_consensus.cc:385] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:26.754685 19750 raft_consensus.cc:740] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3989928a62444b81ac63e00b9e7db901, State: Initialized, Role: FOLLOWER
I20260201 08:59:26.755309 19750 consensus_queue.cc:260] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3989928a62444b81ac63e00b9e7db901" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 46185 } } peers { permanent_uuid: "04a063ff13154f6383ecc7921667310d" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38947 } } peers { permanent_uuid: "d5d0fd319e26453ca466d5fa85b90145" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 40291 } }
I20260201 08:59:26.757120 19734 heartbeater.cc:499] Master 127.18.45.62:36319 was elected leader, sending a full tablet report...
I20260201 08:59:26.756916 19751 raft_consensus.cc:359] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3989928a62444b81ac63e00b9e7db901" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 46185 } } peers { permanent_uuid: "04a063ff13154f6383ecc7921667310d" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38947 } } peers { permanent_uuid: "d5d0fd319e26453ca466d5fa85b90145" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 40291 } }
I20260201 08:59:26.757633 19749 ts_tablet_manager.cc:1434] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d: Time spent starting tablet: real 0.011s user 0.009s sys 0.000s
I20260201 08:59:26.757711 19751 raft_consensus.cc:385] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:26.758121 19751 raft_consensus.cc:740] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5d0fd319e26453ca466d5fa85b90145, State: Initialized, Role: FOLLOWER
I20260201 08:59:26.759032 19660 heartbeater.cc:499] Master 127.18.45.62:36319 was elected leader, sending a full tablet report...
I20260201 08:59:26.759696 19750 ts_tablet_manager.cc:1434] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901: Time spent starting tablet: real 0.009s user 0.001s sys 0.006s
I20260201 08:59:26.759428 19751 consensus_queue.cc:260] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3989928a62444b81ac63e00b9e7db901" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 46185 } } peers { permanent_uuid: "04a063ff13154f6383ecc7921667310d" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38947 } } peers { permanent_uuid: "d5d0fd319e26453ca466d5fa85b90145" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 40291 } }
I20260201 08:59:26.763461 19585 heartbeater.cc:499] Master 127.18.45.62:36319 was elected leader, sending a full tablet report...
I20260201 08:59:26.764111 19751 ts_tablet_manager.cc:1434] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145: Time spent starting tablet: real 0.012s user 0.004s sys 0.004s
I20260201 08:59:26.876526 19757 raft_consensus.cc:493] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:26.876919 19757 raft_consensus.cc:515] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3989928a62444b81ac63e00b9e7db901" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 46185 } } peers { permanent_uuid: "04a063ff13154f6383ecc7921667310d" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38947 } } peers { permanent_uuid: "d5d0fd319e26453ca466d5fa85b90145" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 40291 } }
I20260201 08:59:26.878865 19757 leader_election.cc:290] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3989928a62444b81ac63e00b9e7db901 (127.18.45.2:46185), 04a063ff13154f6383ecc7921667310d (127.18.45.3:38947)
I20260201 08:59:26.888083 19635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b622a7fc249329310f0c08f20a9f0" candidate_uuid: "d5d0fd319e26453ca466d5fa85b90145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3989928a62444b81ac63e00b9e7db901" is_pre_election: true
I20260201 08:59:26.888978 19635 raft_consensus.cc:2468] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5d0fd319e26453ca466d5fa85b90145 in term 0.
I20260201 08:59:26.889008 19709 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b622a7fc249329310f0c08f20a9f0" candidate_uuid: "d5d0fd319e26453ca466d5fa85b90145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04a063ff13154f6383ecc7921667310d" is_pre_election: true
I20260201 08:59:26.889717 19709 raft_consensus.cc:2468] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5d0fd319e26453ca466d5fa85b90145 in term 0.
I20260201 08:59:26.890416 19524 leader_election.cc:304] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3989928a62444b81ac63e00b9e7db901, d5d0fd319e26453ca466d5fa85b90145; no voters:
I20260201 08:59:26.891155 19757 raft_consensus.cc:2804] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:26.891404 19757 raft_consensus.cc:493] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:26.891589 19757 raft_consensus.cc:3060] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:26.895829 19757 raft_consensus.cc:515] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3989928a62444b81ac63e00b9e7db901" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 46185 } } peers { permanent_uuid: "04a063ff13154f6383ecc7921667310d" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38947 } } peers { permanent_uuid: "d5d0fd319e26453ca466d5fa85b90145" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 40291 } }
I20260201 08:59:26.897239 19757 leader_election.cc:290] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145 [CANDIDATE]: Term 1 election: Requested vote from peers 3989928a62444b81ac63e00b9e7db901 (127.18.45.2:46185), 04a063ff13154f6383ecc7921667310d (127.18.45.3:38947)
I20260201 08:59:26.897924 19635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b622a7fc249329310f0c08f20a9f0" candidate_uuid: "d5d0fd319e26453ca466d5fa85b90145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3989928a62444b81ac63e00b9e7db901"
I20260201 08:59:26.898092 19709 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b622a7fc249329310f0c08f20a9f0" candidate_uuid: "d5d0fd319e26453ca466d5fa85b90145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04a063ff13154f6383ecc7921667310d"
I20260201 08:59:26.898399 19635 raft_consensus.cc:3060] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:26.898631 19709 raft_consensus.cc:3060] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:26.902962 19635 raft_consensus.cc:2468] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5d0fd319e26453ca466d5fa85b90145 in term 1.
I20260201 08:59:26.903033 19709 raft_consensus.cc:2468] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5d0fd319e26453ca466d5fa85b90145 in term 1.
I20260201 08:59:26.903800 19524 leader_election.cc:304] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3989928a62444b81ac63e00b9e7db901, d5d0fd319e26453ca466d5fa85b90145; no voters:
I20260201 08:59:26.904400 19757 raft_consensus.cc:2804] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:26.905246 19757 raft_consensus.cc:697] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145 [term 1 LEADER]: Becoming Leader. State: Replica: d5d0fd319e26453ca466d5fa85b90145, State: Running, Role: LEADER
I20260201 08:59:26.905864 19757 consensus_queue.cc:237] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3989928a62444b81ac63e00b9e7db901" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 46185 } } peers { permanent_uuid: "04a063ff13154f6383ecc7921667310d" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38947 } } peers { permanent_uuid: "d5d0fd319e26453ca466d5fa85b90145" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 40291 } }
I20260201 08:59:26.912401 19455 catalog_manager.cc:5654] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5d0fd319e26453ca466d5fa85b90145 (127.18.45.1). New cstate: current_term: 1 leader_uuid: "d5d0fd319e26453ca466d5fa85b90145" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3989928a62444b81ac63e00b9e7db901" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 46185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04a063ff13154f6383ecc7921667310d" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5d0fd319e26453ca466d5fa85b90145" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 40291 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:27.334444 19757 consensus_queue.cc:1048] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04a063ff13154f6383ecc7921667310d" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:27.344043 19765 consensus_queue.cc:1048] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3989928a62444b81ac63e00b9e7db901" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 46185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:27.992210 18612 tablet_replica.cc:333] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145: stopping tablet replica
I20260201 08:59:27.992697 18612 raft_consensus.cc:2243] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145 [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:27.993335 18612 raft_consensus.cc:2272] T c84b622a7fc249329310f0c08f20a9f0 P d5d0fd319e26453ca466d5fa85b90145 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:30.019342 19770 raft_consensus.cc:493] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d5d0fd319e26453ca466d5fa85b90145)
I20260201 08:59:30.019915 19770 raft_consensus.cc:515] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3989928a62444b81ac63e00b9e7db901" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 46185 } } peers { permanent_uuid: "04a063ff13154f6383ecc7921667310d" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38947 } } peers { permanent_uuid: "d5d0fd319e26453ca466d5fa85b90145" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 40291 } }
I20260201 08:59:30.022256 19770 leader_election.cc:290] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3989928a62444b81ac63e00b9e7db901 (127.18.45.2:46185), d5d0fd319e26453ca466d5fa85b90145 (127.18.45.1:40291)
I20260201 08:59:30.071914 19774 raft_consensus.cc:493] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d5d0fd319e26453ca466d5fa85b90145)
I20260201 08:59:30.073088 19774 raft_consensus.cc:515] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3989928a62444b81ac63e00b9e7db901" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 46185 } } peers { permanent_uuid: "04a063ff13154f6383ecc7921667310d" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38947 } } peers { permanent_uuid: "d5d0fd319e26453ca466d5fa85b90145" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 40291 } }
I20260201 08:59:30.082377 19774 leader_election.cc:290] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04a063ff13154f6383ecc7921667310d (127.18.45.3:38947), d5d0fd319e26453ca466d5fa85b90145 (127.18.45.1:40291)
I20260201 08:59:30.082299 19635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b622a7fc249329310f0c08f20a9f0" candidate_uuid: "04a063ff13154f6383ecc7921667310d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3989928a62444b81ac63e00b9e7db901" is_pre_election: true
I20260201 08:59:30.084168 19635 raft_consensus.cc:2468] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04a063ff13154f6383ecc7921667310d in term 1.
I20260201 08:59:30.085562 19673 leader_election.cc:304] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04a063ff13154f6383ecc7921667310d, 3989928a62444b81ac63e00b9e7db901; no voters:
I20260201 08:59:30.086465 19770 raft_consensus.cc:2804] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:30.086800 19770 raft_consensus.cc:493] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [term 1 FOLLOWER]: Starting leader election (detected failure of leader d5d0fd319e26453ca466d5fa85b90145)
I20260201 08:59:30.087188 19770 raft_consensus.cc:3060] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:30.098666 19770 raft_consensus.cc:515] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3989928a62444b81ac63e00b9e7db901" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 46185 } } peers { permanent_uuid: "04a063ff13154f6383ecc7921667310d" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38947 } } peers { permanent_uuid: "d5d0fd319e26453ca466d5fa85b90145" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 40291 } }
I20260201 08:59:30.100409 19770 leader_election.cc:290] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [CANDIDATE]: Term 2 election: Requested vote from peers 3989928a62444b81ac63e00b9e7db901 (127.18.45.2:46185), d5d0fd319e26453ca466d5fa85b90145 (127.18.45.1:40291)
I20260201 08:59:30.100962 19709 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b622a7fc249329310f0c08f20a9f0" candidate_uuid: "3989928a62444b81ac63e00b9e7db901" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04a063ff13154f6383ecc7921667310d" is_pre_election: true
I20260201 08:59:30.101382 19635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b622a7fc249329310f0c08f20a9f0" candidate_uuid: "04a063ff13154f6383ecc7921667310d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3989928a62444b81ac63e00b9e7db901"
I20260201 08:59:30.101683 19709 raft_consensus.cc:2393] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3989928a62444b81ac63e00b9e7db901 in current term 2: Already voted for candidate 04a063ff13154f6383ecc7921667310d in this term.
I20260201 08:59:30.101999 19635 raft_consensus.cc:3060] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:30.107100 19635 raft_consensus.cc:2468] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04a063ff13154f6383ecc7921667310d in term 2.
I20260201 08:59:30.108157 19673 leader_election.cc:304] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04a063ff13154f6383ecc7921667310d, 3989928a62444b81ac63e00b9e7db901; no voters:
I20260201 08:59:30.108645 19560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b622a7fc249329310f0c08f20a9f0" candidate_uuid: "04a063ff13154f6383ecc7921667310d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5d0fd319e26453ca466d5fa85b90145" is_pre_election: true
I20260201 08:59:30.108958 19559 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b622a7fc249329310f0c08f20a9f0" candidate_uuid: "04a063ff13154f6383ecc7921667310d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5d0fd319e26453ca466d5fa85b90145"
I20260201 08:59:30.109149 19770 raft_consensus.cc:2804] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:30.110069 19558 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b622a7fc249329310f0c08f20a9f0" candidate_uuid: "3989928a62444b81ac63e00b9e7db901" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5d0fd319e26453ca466d5fa85b90145" is_pre_election: true
W20260201 08:59:30.111057 19675 leader_election.cc:343] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d5d0fd319e26453ca466d5fa85b90145 (127.18.45.1:40291): Illegal state: cannot vote while shut down
W20260201 08:59:30.111737 19675 leader_election.cc:343] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d5d0fd319e26453ca466d5fa85b90145 (127.18.45.1:40291): Illegal state: cannot vote while shut down
W20260201 08:59:30.112763 19601 leader_election.cc:343] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d5d0fd319e26453ca466d5fa85b90145 (127.18.45.1:40291): Illegal state: cannot vote while shut down
I20260201 08:59:30.112788 19770 raft_consensus.cc:697] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [term 2 LEADER]: Becoming Leader. State: Replica: 04a063ff13154f6383ecc7921667310d, State: Running, Role: LEADER
I20260201 08:59:30.113281 19601 leader_election.cc:304] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3989928a62444b81ac63e00b9e7db901; no voters: 04a063ff13154f6383ecc7921667310d, d5d0fd319e26453ca466d5fa85b90145
I20260201 08:59:30.113873 19774 raft_consensus.cc:2749] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:30.113685 19770 consensus_queue.cc:237] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3989928a62444b81ac63e00b9e7db901" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 46185 } } peers { permanent_uuid: "04a063ff13154f6383ecc7921667310d" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38947 } } peers { permanent_uuid: "d5d0fd319e26453ca466d5fa85b90145" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 40291 } }
I20260201 08:59:30.507488 19635 raft_consensus.cc:1275] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901 [term 2 FOLLOWER]: Refusing update from remote peer 04a063ff13154f6383ecc7921667310d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:30.508476 19770 consensus_queue.cc:1048] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3989928a62444b81ac63e00b9e7db901" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 46185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:30.516647 19675 consensus_queue.cc:579] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [LEADER]: The tablet replica hosted on peer d5d0fd319e26453ca466d5fa85b90145 has failed
W20260201 08:59:30.517081 19675 consensus_peers.cc:597] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d -> Peer d5d0fd319e26453ca466d5fa85b90145 (127.18.45.1:40291): Couldn't send request to peer d5d0fd319e26453ca466d5fa85b90145. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: IO error: INJECTED ERROR: tablet failed. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:31.021801 18612 tablet_server.cc:178] TabletServer@127.18.45.1:0 shutting down...
W20260201 08:59:31.036564 19730 debug-util.cc:398] Leaking SignalData structure 0x7b0800173060 after lost signal to thread 18615
W20260201 08:59:31.037413 19730 debug-util.cc:398] Leaking SignalData structure 0x7b08001737c0 after lost signal to thread 19491
I20260201 08:59:31.037796 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 08:59:31.055231 18612 tablet_server.cc:195] TabletServer@127.18.45.1:0 shutdown complete.
I20260201 08:59:31.063148 18612 tablet_server.cc:178] TabletServer@127.18.45.2:0 shutting down...
I20260201 08:59:31.084372 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 08:59:31.085093 18612 tablet_replica.cc:333] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901: stopping tablet replica
I20260201 08:59:31.085680 18612 raft_consensus.cc:2243] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:31.086128 18612 raft_consensus.cc:2272] T c84b622a7fc249329310f0c08f20a9f0 P 3989928a62444b81ac63e00b9e7db901 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:31.105643 18612 tablet_server.cc:195] TabletServer@127.18.45.2:0 shutdown complete.
I20260201 08:59:31.115360 18612 tablet_server.cc:178] TabletServer@127.18.45.3:0 shutting down...
I20260201 08:59:31.132213 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 08:59:31.132730 18612 tablet_replica.cc:333] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d: stopping tablet replica
I20260201 08:59:31.133229 18612 raft_consensus.cc:2243] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:31.133831 18612 raft_consensus.cc:2272] T c84b622a7fc249329310f0c08f20a9f0 P 04a063ff13154f6383ecc7921667310d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260201 08:59:32.139820 18612 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 19730)
I20260201 08:59:32.629086 18612 tablet_server.cc:195] TabletServer@127.18.45.3:0 shutdown complete.
I20260201 08:59:32.636199 18612 master.cc:561] Master@127.18.45.62:36319 shutting down...
I20260201 08:59:32.653611 18612 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125 [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:32.653973 18612 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:32.654191 18612 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3168268d35a2471d889a2edfade13125: stopping tablet replica
I20260201 08:59:32.670737 18612 master.cc:583] Master@127.18.45.62:36319 shutdown complete.
[ OK ] TsTabletManagerITest.ReportOnReplicaHealthStatus (6550 ms)
[ RUN ] TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters
I20260201 08:59:32.697053 18612 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.45.62:41873
I20260201 08:59:32.697992 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:32.702124 19789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:32.703032 19790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:32.704818 18612 server_base.cc:1060] running on GCE node
W20260201 08:59:32.705183 19792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:32.705932 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:32.706086 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:32.706265 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936372706231 us; error 0 us; skew 500 ppm
I20260201 08:59:32.706751 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:32.708606 18612 webserver.cc:492] Webserver started at http://127.18.45.62:42283/ using document root <none> and password file <none>
I20260201 08:59:32.709132 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:32.709296 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:32.709527 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:32.710371 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1769936356186478-18612-0/minicluster-data/master-0-root/instance:
uuid: "caf523a1e98a41e4b1d9d3b50f3c6810"
format_stamp: "Formatted at 2026-02-01 08:59:32 on dist-test-slave-zz6f"
I20260201 08:59:32.713918 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260201 08:59:32.716660 19797 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:32.717298 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260201 08:59:32.717568 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1769936356186478-18612-0/minicluster-data/master-0-root
uuid: "caf523a1e98a41e4b1d9d3b50f3c6810"
format_stamp: "Formatted at 2026-02-01 08:59:32 on dist-test-slave-zz6f"
I20260201 08:59:32.717823 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1769936356186478-18612-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1769936356186478-18612-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1769936356186478-18612-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:32.745504 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:32.746452 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:32.779214 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.62:41873
I20260201 08:59:32.779304 19848 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.62:41873 every 8 connection(s)
I20260201 08:59:32.782292 19849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:32.790688 19849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810: Bootstrap starting.
I20260201 08:59:32.794783 19849 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:32.798030 19849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810: No bootstrap required, opened a new log
I20260201 08:59:32.799688 19849 raft_consensus.cc:359] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caf523a1e98a41e4b1d9d3b50f3c6810" member_type: VOTER }
I20260201 08:59:32.799993 19849 raft_consensus.cc:385] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:32.800155 19849 raft_consensus.cc:740] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caf523a1e98a41e4b1d9d3b50f3c6810, State: Initialized, Role: FOLLOWER
I20260201 08:59:32.800547 19849 consensus_queue.cc:260] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caf523a1e98a41e4b1d9d3b50f3c6810" member_type: VOTER }
I20260201 08:59:32.800932 19849 raft_consensus.cc:399] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 08:59:32.801082 19849 raft_consensus.cc:493] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 08:59:32.801259 19849 raft_consensus.cc:3060] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:32.804522 19849 raft_consensus.cc:515] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caf523a1e98a41e4b1d9d3b50f3c6810" member_type: VOTER }
I20260201 08:59:32.804979 19849 leader_election.cc:304] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: caf523a1e98a41e4b1d9d3b50f3c6810; no voters:
I20260201 08:59:32.805922 19849 leader_election.cc:290] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 08:59:32.806190 19852 raft_consensus.cc:2804] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:32.807544 19852 raft_consensus.cc:697] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810 [term 1 LEADER]: Becoming Leader. State: Replica: caf523a1e98a41e4b1d9d3b50f3c6810, State: Running, Role: LEADER
I20260201 08:59:32.808117 19852 consensus_queue.cc:237] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caf523a1e98a41e4b1d9d3b50f3c6810" member_type: VOTER }
I20260201 08:59:32.808677 19849 sys_catalog.cc:565] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810 [sys.catalog]: configured and running, proceeding with master startup.
I20260201 08:59:32.812904 19854 sys_catalog.cc:455] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810 [sys.catalog]: SysCatalogTable state changed. Reason: New leader caf523a1e98a41e4b1d9d3b50f3c6810. Latest consensus state: current_term: 1 leader_uuid: "caf523a1e98a41e4b1d9d3b50f3c6810" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caf523a1e98a41e4b1d9d3b50f3c6810" member_type: VOTER } }
I20260201 08:59:32.813421 19854 sys_catalog.cc:458] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810 [sys.catalog]: This master's current role is: LEADER
I20260201 08:59:32.813437 19853 sys_catalog.cc:455] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "caf523a1e98a41e4b1d9d3b50f3c6810" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caf523a1e98a41e4b1d9d3b50f3c6810" member_type: VOTER } }
I20260201 08:59:32.814080 19853 sys_catalog.cc:458] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810 [sys.catalog]: This master's current role is: LEADER
I20260201 08:59:32.815133 19859 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 08:59:32.819864 19859 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 08:59:32.825235 18612 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260201 08:59:32.827143 19859 catalog_manager.cc:1357] Generated new cluster ID: bdb5f41dd65943c8b97f8f2429599bce
I20260201 08:59:32.827382 19859 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 08:59:32.849588 19859 catalog_manager.cc:1380] Generated new certificate authority record
I20260201 08:59:32.850503 19859 catalog_manager.cc:1514] Loading token signing keys...
I20260201 08:59:32.861258 19859 catalog_manager.cc:6027] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810: Generated new TSK 0
I20260201 08:59:32.861675 19859 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 08:59:32.891271 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:32.896148 19870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:32.897091 19871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:32.899226 18612 server_base.cc:1060] running on GCE node
W20260201 08:59:32.899262 19873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:32.900024 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:32.900228 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:32.900358 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936372900346 us; error 0 us; skew 500 ppm
I20260201 08:59:32.900908 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:32.902815 18612 webserver.cc:492] Webserver started at http://127.18.45.1:40181/ using document root <none> and password file <none>
I20260201 08:59:32.903240 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:32.903438 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:32.903680 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:32.904744 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1769936356186478-18612-0/minicluster-data/ts-0-root/instance:
uuid: "233da2ae17df44ec8187f40c9b8b1229"
format_stamp: "Formatted at 2026-02-01 08:59:32 on dist-test-slave-zz6f"
I20260201 08:59:32.908572 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260201 08:59:32.911307 19878 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:32.911976 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260201 08:59:32.912240 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1769936356186478-18612-0/minicluster-data/ts-0-root
uuid: "233da2ae17df44ec8187f40c9b8b1229"
format_stamp: "Formatted at 2026-02-01 08:59:32 on dist-test-slave-zz6f"
I20260201 08:59:32.912537 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1769936356186478-18612-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1769936356186478-18612-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1769936356186478-18612-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:32.936053 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:32.936970 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:32.938128 18612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:59:32.940064 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:59:32.940295 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:32.940521 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:59:32.940680 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:32.973445 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.1:37735
I20260201 08:59:32.973557 19940 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.1:37735 every 8 connection(s)
I20260201 08:59:32.989179 19941 heartbeater.cc:344] Connected to a master server at 127.18.45.62:41873
I20260201 08:59:32.989493 19941 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:32.990067 19941 heartbeater.cc:507] Master 127.18.45.62:41873 requested a full tablet report, sending...
I20260201 08:59:32.991632 19814 ts_manager.cc:194] Registered new tserver with Master: 233da2ae17df44ec8187f40c9b8b1229 (127.18.45.1:37735)
I20260201 08:59:32.992134 18612 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.015927091s
I20260201 08:59:32.993148 19814 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44592
I20260201 08:59:33.008188 18612 tablet_server.cc:178] TabletServer@127.18.45.1:0 shutting down...
I20260201 08:59:33.021672 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 08:59:33.036083 18612 tablet_server.cc:195] TabletServer@127.18.45.1:0 shutdown complete.
I20260201 08:59:33.042418 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260201 08:59:33.044713 18612 tablet_server.cc:93] deduplicated master addresses: 127.18.45.62:41873
W20260201 08:59:33.047703 19952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:33.048430 19951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:33.049324 18612 server_base.cc:1060] running on GCE node
W20260201 08:59:33.049391 19954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:33.050196 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:33.050384 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:33.050527 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936373050515 us; error 0 us; skew 500 ppm
I20260201 08:59:33.050990 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:33.052752 18612 webserver.cc:492] Webserver started at http://127.18.45.1:40181/ using document root <none> and password file <none>
I20260201 08:59:33.053206 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:33.053361 18612 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260201 08:59:33.056247 18612 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260201 08:59:33.058357 19959 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:33.058934 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260201 08:59:33.059185 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1769936356186478-18612-0/minicluster-data/ts-0-root
uuid: "233da2ae17df44ec8187f40c9b8b1229"
format_stamp: "Formatted at 2026-02-01 08:59:32 on dist-test-slave-zz6f"
I20260201 08:59:33.059450 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1769936356186478-18612-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1769936356186478-18612-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1769936356186478-18612-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:33.081683 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:33.082489 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:33.083829 18612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:59:33.085819 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:59:33.086001 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:33.086194 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:59:33.086336 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:33.119104 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.1:37735
I20260201 08:59:33.119248 20021 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.1:37735 every 8 connection(s)
I20260201 08:59:33.123948 18612 tablet_server.cc:178] TabletServer@127.18.45.1:37735 shutting down...
I20260201 08:59:33.137862 20022 heartbeater.cc:344] Connected to a master server at 127.18.45.62:41873
I20260201 08:59:33.138183 20022 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:33.138819 20022 heartbeater.cc:507] Master 127.18.45.62:41873 requested a full tablet report, sending...
I20260201 08:59:33.141270 19814 ts_manager.cc:194] Re-registered known tserver with Master: 233da2ae17df44ec8187f40c9b8b1229 (127.18.45.1:37735)
I20260201 08:59:33.142424 19814 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44618
I20260201 08:59:33.144728 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 08:59:33.159008 18612 tablet_server.cc:195] TabletServer@127.18.45.1:37735 shutdown complete.
I20260201 08:59:33.164556 18612 master.cc:561] Master@127.18.45.62:41873 shutting down...
I20260201 08:59:33.176663 18612 raft_consensus.cc:2243] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810 [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:33.177103 18612 raft_consensus.cc:2272] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:33.177495 18612 tablet_replica.cc:333] T 00000000000000000000000000000000 P caf523a1e98a41e4b1d9d3b50f3c6810: stopping tablet replica
I20260201 08:59:33.194588 18612 master.cc:583] Master@127.18.45.62:41873 shutdown complete.
[ OK ] TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters (516 ms)
[ RUN ] TsTabletManagerITest.TestTableStats
I20260201 08:59:33.213446 18612 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.45.62:34393,127.18.45.61:37187,127.18.45.60:41717
I20260201 08:59:33.215175 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:33.219432 20029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:33.220602 20030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:33.225085 18612 server_base.cc:1060] running on GCE node
W20260201 08:59:33.226276 20032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:33.226931 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:33.227077 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:33.227270 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936373227243 us; error 0 us; skew 500 ppm
I20260201 08:59:33.227731 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:33.229583 18612 webserver.cc:492] Webserver started at http://127.18.45.62:43385/ using document root <none> and password file <none>
I20260201 08:59:33.229969 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:33.230135 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:33.230374 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:33.231323 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/master-0-root/instance:
uuid: "0c8e1752930448a8877eff36fdda0689"
format_stamp: "Formatted at 2026-02-01 08:59:33 on dist-test-slave-zz6f"
I20260201 08:59:33.235076 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260201 08:59:33.237870 20037 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:33.238488 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260201 08:59:33.238741 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/master-0-root
uuid: "0c8e1752930448a8877eff36fdda0689"
format_stamp: "Formatted at 2026-02-01 08:59:33 on dist-test-slave-zz6f"
I20260201 08:59:33.238996 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:33.251999 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:33.252799 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:33.284307 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.62:34393
I20260201 08:59:33.284399 20088 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.62:34393 every 8 connection(s)
I20260201 08:59:33.287719 20089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:33.287881 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:33.292450 20091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:33.293708 20092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:33.294322 20089 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } has no permanent_uuid. Determining permanent_uuid...
W20260201 08:59:33.295956 20094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:33.296103 18612 server_base.cc:1060] running on GCE node
I20260201 08:59:33.296911 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:33.297098 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:33.297282 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936373297269 us; error 0 us; skew 500 ppm
I20260201 08:59:33.297724 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:33.300182 18612 webserver.cc:492] Webserver started at http://127.18.45.61:44557/ using document root <none> and password file <none>
I20260201 08:59:33.300666 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:33.300843 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:33.301115 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:33.302095 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/master-1-root/instance:
uuid: "0881025374f24934891bbdb80e59dbf2"
format_stamp: "Formatted at 2026-02-01 08:59:33 on dist-test-slave-zz6f"
I20260201 08:59:33.306938 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260201 08:59:33.306942 20089 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } has no permanent_uuid. Determining permanent_uuid...
W20260201 08:59:33.309087 20041 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.45.61:37187: connect: Connection refused (error 111)
I20260201 08:59:33.310845 20102 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:33.311702 18612 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260201 08:59:33.311944 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/master-1-root
uuid: "0881025374f24934891bbdb80e59dbf2"
format_stamp: "Formatted at 2026-02-01 08:59:33 on dist-test-slave-zz6f"
W20260201 08:59:33.312255 20089 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.45.61:37187: Network error: Client connection negotiation failed: client connection to 127.18.45.61:37187: connect: Connection refused (error 111)
I20260201 08:59:33.312180 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:33.324055 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:33.324873 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:33.350735 20089 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } attempt: 1
W20260201 08:59:33.355237 20089 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.45.61:37187: Network error: Client connection negotiation failed: client connection to 127.18.45.61:37187: connect: Connection refused (error 111)
I20260201 08:59:33.358287 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.61:37187
I20260201 08:59:33.358369 20153 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.61:37187 every 8 connection(s)
I20260201 08:59:33.361559 20154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:33.361671 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:33.366000 20156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:33.366858 20157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:33.369480 20154 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } has no permanent_uuid. Determining permanent_uuid...
I20260201 08:59:33.370820 18612 server_base.cc:1060] running on GCE node
W20260201 08:59:33.371276 20159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:33.372066 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:33.372279 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:33.372437 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936373372421 us; error 0 us; skew 500 ppm
I20260201 08:59:33.372941 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:33.375252 18612 webserver.cc:492] Webserver started at http://127.18.45.60:37743/ using document root <none> and password file <none>
I20260201 08:59:33.375751 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:33.375952 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:33.376231 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:33.377492 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/master-2-root/instance:
uuid: "cdf47e38da57474fa9a1f6f8698dd6ec"
format_stamp: "Formatted at 2026-02-01 08:59:33 on dist-test-slave-zz6f"
I20260201 08:59:33.379910 20154 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } has no permanent_uuid. Determining permanent_uuid...
I20260201 08:59:33.383299 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260201 08:59:33.386703 20166 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:33.387535 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260201 08:59:33.387794 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/master-2-root
uuid: "cdf47e38da57474fa9a1f6f8698dd6ec"
format_stamp: "Formatted at 2026-02-01 08:59:33 on dist-test-slave-zz6f"
I20260201 08:59:33.388042 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:33.389477 20154 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } has no permanent_uuid. Determining permanent_uuid...
W20260201 08:59:33.394474 20154 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.45.60:41717: Network error: Client connection negotiation failed: client connection to 127.18.45.60:41717: connect: Connection refused (error 111)
I20260201 08:59:33.395718 20089 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } attempt: 2
I20260201 08:59:33.403836 20089 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } has no permanent_uuid. Determining permanent_uuid...
I20260201 08:59:33.406075 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:33.407217 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260201 08:59:33.407665 20089 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.45.60:41717: Network error: Client connection negotiation failed: client connection to 127.18.45.60:41717: connect: Connection refused (error 111)
I20260201 08:59:33.429905 20154 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } attempt: 1
W20260201 08:59:33.434139 20154 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.45.60:41717: Network error: Client connection negotiation failed: client connection to 127.18.45.60:41717: connect: Connection refused (error 111)
I20260201 08:59:33.439880 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.60:41717
I20260201 08:59:33.439946 20218 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.60:41717 every 8 connection(s)
I20260201 08:59:33.441017 20089 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } attempt: 1
I20260201 08:59:33.443969 20219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:33.445160 18612 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260201 08:59:33.451217 20219 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } has no permanent_uuid. Determining permanent_uuid...
I20260201 08:59:33.459857 20089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689: Bootstrap starting.
I20260201 08:59:33.465030 20219 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } has no permanent_uuid. Determining permanent_uuid...
I20260201 08:59:33.465530 20089 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:33.471024 20089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689: No bootstrap required, opened a new log
I20260201 08:59:33.473366 20089 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:33.473963 20089 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:33.474210 20089 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8e1752930448a8877eff36fdda0689, State: Initialized, Role: FOLLOWER
I20260201 08:59:33.474839 20089 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:33.476274 20219 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } has no permanent_uuid. Determining permanent_uuid...
I20260201 08:59:33.476802 20224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:33.477499 20224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [sys.catalog]: This master's current role is: FOLLOWER
I20260201 08:59:33.478229 20089 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [sys.catalog]: configured and running, proceeding with master startup.
I20260201 08:59:33.489559 18612 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260201 08:59:33.491499 20219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec: Bootstrap starting.
W20260201 08:59:33.492231 20235 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260201 08:59:33.492496 20235 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260201 08:59:33.495321 20219 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:33.498483 20219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec: No bootstrap required, opened a new log
I20260201 08:59:33.500078 20219 raft_consensus.cc:359] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:33.500516 20219 raft_consensus.cc:385] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:33.500722 20219 raft_consensus.cc:740] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdf47e38da57474fa9a1f6f8698dd6ec, State: Initialized, Role: FOLLOWER
I20260201 08:59:33.501221 20219 consensus_queue.cc:260] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:33.502489 20237 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:33.502936 20237 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [sys.catalog]: This master's current role is: FOLLOWER
I20260201 08:59:33.503449 20219 sys_catalog.cc:565] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [sys.catalog]: configured and running, proceeding with master startup.
I20260201 08:59:33.509534 20154 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } attempt: 2
W20260201 08:59:33.517441 20248 catalog_manager.cc:1568] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260201 08:59:33.517726 20248 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260201 08:59:33.521817 20154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2: Bootstrap starting.
I20260201 08:59:33.525420 20154 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:33.528635 20154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2: No bootstrap required, opened a new log
I20260201 08:59:33.530244 20154 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:33.530674 20154 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:33.530858 20154 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0881025374f24934891bbdb80e59dbf2, State: Initialized, Role: FOLLOWER
I20260201 08:59:33.531358 20154 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:33.532713 20250 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:33.533234 20250 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [sys.catalog]: This master's current role is: FOLLOWER
I20260201 08:59:33.533819 20154 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [sys.catalog]: configured and running, proceeding with master startup.
I20260201 08:59:33.542971 18612 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260201 08:59:33.544482 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:33.546593 20261 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260201 08:59:33.546852 20261 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260201 08:59:33.550516 20262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:33.551084 20263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:33.552441 20265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:33.553361 18612 server_base.cc:1060] running on GCE node
I20260201 08:59:33.554036 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:33.554208 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:33.554363 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936373554350 us; error 0 us; skew 500 ppm
I20260201 08:59:33.554770 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:33.555486 20237 raft_consensus.cc:493] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:33.555837 20237 raft_consensus.cc:515] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:33.557188 18612 webserver.cc:492] Webserver started at http://127.18.45.1:35197/ using document root <none> and password file <none>
I20260201 08:59:33.557282 20237 leader_election.cc:290] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8e1752930448a8877eff36fdda0689 (127.18.45.62:34393), 0881025374f24934891bbdb80e59dbf2 (127.18.45.61:37187)
I20260201 08:59:33.557813 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:33.558086 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:33.557955 20064 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8e1752930448a8877eff36fdda0689" is_pre_election: true
I20260201 08:59:33.558156 20129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0881025374f24934891bbdb80e59dbf2" is_pre_election: true
I20260201 08:59:33.558432 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:33.558578 20064 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdf47e38da57474fa9a1f6f8698dd6ec in term 0.
I20260201 08:59:33.558833 20129 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdf47e38da57474fa9a1f6f8698dd6ec in term 0.
I20260201 08:59:33.559654 20169 leader_election.cc:304] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8e1752930448a8877eff36fdda0689, cdf47e38da57474fa9a1f6f8698dd6ec; no voters:
I20260201 08:59:33.559929 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/ts-0-root/instance:
uuid: "d9e4e07649b441e9b1e9e5da9361cec3"
format_stamp: "Formatted at 2026-02-01 08:59:33 on dist-test-slave-zz6f"
I20260201 08:59:33.560321 20237 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:33.560657 20237 raft_consensus.cc:493] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:33.560978 20237 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:33.564551 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s
I20260201 08:59:33.565593 20237 raft_consensus.cc:515] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:33.567034 20237 leader_election.cc:290] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [CANDIDATE]: Term 1 election: Requested vote from peers 0c8e1752930448a8877eff36fdda0689 (127.18.45.62:34393), 0881025374f24934891bbdb80e59dbf2 (127.18.45.61:37187)
I20260201 08:59:33.567756 20064 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8e1752930448a8877eff36fdda0689"
I20260201 08:59:33.567850 20129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0881025374f24934891bbdb80e59dbf2"
I20260201 08:59:33.568269 20270 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:33.568353 20064 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:33.568441 20129 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:33.569193 18612 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260201 08:59:33.569583 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/ts-0-root
uuid: "d9e4e07649b441e9b1e9e5da9361cec3"
format_stamp: "Formatted at 2026-02-01 08:59:33 on dist-test-slave-zz6f"
I20260201 08:59:33.569955 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:33.572710 20129 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf47e38da57474fa9a1f6f8698dd6ec in term 1.
I20260201 08:59:33.573655 20171 leader_election.cc:304] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0881025374f24934891bbdb80e59dbf2, cdf47e38da57474fa9a1f6f8698dd6ec; no voters:
I20260201 08:59:33.574532 20237 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:33.575305 20064 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf47e38da57474fa9a1f6f8698dd6ec in term 1.
I20260201 08:59:33.577263 20237 raft_consensus.cc:697] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 1 LEADER]: Becoming Leader. State: Replica: cdf47e38da57474fa9a1f6f8698dd6ec, State: Running, Role: LEADER
I20260201 08:59:33.577955 20237 consensus_queue.cc:237] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:33.581339 20275 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdf47e38da57474fa9a1f6f8698dd6ec. Latest consensus state: current_term: 1 leader_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:33.581918 20275 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [sys.catalog]: This master's current role is: LEADER
I20260201 08:59:33.583163 20277 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 08:59:33.587467 20277 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 08:59:33.588042 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:33.589046 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:33.590536 18612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:59:33.592942 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:59:33.593204 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:33.593523 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:59:33.593752 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:33.594692 20064 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 1 FOLLOWER]: Refusing update from remote peer cdf47e38da57474fa9a1f6f8698dd6ec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:59:33.594658 20129 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 1 FOLLOWER]: Refusing update from remote peer cdf47e38da57474fa9a1f6f8698dd6ec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:59:33.596046 20237 consensus_queue.cc:1048] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:33.596709 20275 consensus_queue.cc:1048] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:33.609225 20250 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdf47e38da57474fa9a1f6f8698dd6ec. Latest consensus state: current_term: 1 leader_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:33.609879 20250 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [sys.catalog]: This master's current role is: FOLLOWER
I20260201 08:59:33.612592 20224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdf47e38da57474fa9a1f6f8698dd6ec. Latest consensus state: current_term: 1 leader_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:33.613185 20279 mvcc.cc:204] Tried to move back new op lower bound from 7249659386233372672 to 7249659386181595136. Current Snapshot: MvccSnapshot[applied={T|T < 7249659386233372672}]
I20260201 08:59:33.613474 20224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [sys.catalog]: This master's current role is: FOLLOWER
I20260201 08:59:33.621933 20224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:33.622714 20224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [sys.catalog]: This master's current role is: FOLLOWER
I20260201 08:59:33.625948 20250 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:33.626543 20250 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [sys.catalog]: This master's current role is: FOLLOWER
I20260201 08:59:33.629782 20237 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:33.630594 20237 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [sys.catalog]: This master's current role is: LEADER
I20260201 08:59:33.630865 20277 catalog_manager.cc:1357] Generated new cluster ID: 56278e18ac6043958bcc9e9de47661ab
I20260201 08:59:33.631199 20277 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 08:59:33.636404 20275 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:33.637037 20275 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [sys.catalog]: This master's current role is: LEADER
I20260201 08:59:33.667389 20277 catalog_manager.cc:1380] Generated new certificate authority record
I20260201 08:59:33.668789 20277 catalog_manager.cc:1514] Loading token signing keys...
I20260201 08:59:33.680758 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.1:39191
I20260201 08:59:33.680959 20344 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.1:39191 every 8 connection(s)
I20260201 08:59:33.696938 20277 catalog_manager.cc:6027] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec: Generated new TSK 0
I20260201 08:59:33.697542 20277 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 08:59:33.707320 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260201 08:59:33.708298 20345 heartbeater.cc:344] Connected to a master server at 127.18.45.60:41717
I20260201 08:59:33.708714 20345 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:33.709440 20346 heartbeater.cc:344] Connected to a master server at 127.18.45.61:37187
I20260201 08:59:33.709481 20345 heartbeater.cc:507] Master 127.18.45.60:41717 requested a full tablet report, sending...
I20260201 08:59:33.709892 20346 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:33.710664 20346 heartbeater.cc:507] Master 127.18.45.61:37187 requested a full tablet report, sending...
I20260201 08:59:33.712296 20184 ts_manager.cc:194] Registered new tserver with Master: d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191)
I20260201 08:59:33.714177 20119 ts_manager.cc:194] Registered new tserver with Master: d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191)
I20260201 08:59:33.715322 20184 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57696
I20260201 08:59:33.716921 20347 heartbeater.cc:344] Connected to a master server at 127.18.45.62:34393
I20260201 08:59:33.717322 20347 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:33.718281 20347 heartbeater.cc:507] Master 127.18.45.62:34393 requested a full tablet report, sending...
W20260201 08:59:33.718984 20352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:33.720516 20054 ts_manager.cc:194] Registered new tserver with Master: d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191)
W20260201 08:59:33.722308 20353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:33.725111 18612 server_base.cc:1060] running on GCE node
W20260201 08:59:33.725200 20355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:33.726071 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:33.726275 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:33.726434 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936373726420 us; error 0 us; skew 500 ppm
I20260201 08:59:33.726881 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:33.728749 18612 webserver.cc:492] Webserver started at http://127.18.45.2:40757/ using document root <none> and password file <none>
I20260201 08:59:33.729231 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:33.729408 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:33.729642 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:33.730686 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/ts-1-root/instance:
uuid: "9b54beaf2b694237916e31bea8d1a6a5"
format_stamp: "Formatted at 2026-02-01 08:59:33 on dist-test-slave-zz6f"
I20260201 08:59:33.734460 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260201 08:59:33.737577 20360 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:33.738229 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260201 08:59:33.738487 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/ts-1-root
uuid: "9b54beaf2b694237916e31bea8d1a6a5"
format_stamp: "Formatted at 2026-02-01 08:59:33 on dist-test-slave-zz6f"
I20260201 08:59:33.738770 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:33.753242 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:33.754236 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:33.755985 18612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:59:33.758486 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:59:33.758646 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:33.758802 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:59:33.758912 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:33.821197 20345 heartbeater.cc:499] Master 127.18.45.60:41717 was elected leader, sending a full tablet report...
I20260201 08:59:33.831751 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.2:33763
I20260201 08:59:33.831836 20422 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.2:33763 every 8 connection(s)
I20260201 08:59:33.853276 20423 heartbeater.cc:344] Connected to a master server at 127.18.45.60:41717
I20260201 08:59:33.853528 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260201 08:59:33.853650 20423 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:33.854473 20423 heartbeater.cc:507] Master 127.18.45.60:41717 requested a full tablet report, sending...
I20260201 08:59:33.856563 20184 ts_manager.cc:194] Registered new tserver with Master: 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 08:59:33.860658 20184 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57702
I20260201 08:59:33.863487 20425 heartbeater.cc:344] Connected to a master server at 127.18.45.62:34393
I20260201 08:59:33.863876 20425 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:33.864604 20424 heartbeater.cc:344] Connected to a master server at 127.18.45.61:37187
I20260201 08:59:33.864703 20425 heartbeater.cc:507] Master 127.18.45.62:34393 requested a full tablet report, sending...
I20260201 08:59:33.865289 20424 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:33.866235 20424 heartbeater.cc:507] Master 127.18.45.61:37187 requested a full tablet report, sending...
I20260201 08:59:33.867233 20054 ts_manager.cc:194] Registered new tserver with Master: 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
W20260201 08:59:33.868372 20430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:33.869624 20119 ts_manager.cc:194] Registered new tserver with Master: 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
W20260201 08:59:33.870873 20431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:33.873864 20433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:33.874779 18612 server_base.cc:1060] running on GCE node
I20260201 08:59:33.875535 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:33.875748 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:33.875926 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936373875908 us; error 0 us; skew 500 ppm
I20260201 08:59:33.876447 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:33.878516 18612 webserver.cc:492] Webserver started at http://127.18.45.3:36529/ using document root <none> and password file <none>
I20260201 08:59:33.878947 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:33.879128 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:33.879381 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:33.880486 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/ts-2-root/instance:
uuid: "1d8a0e7216f2425d848f56d2a1cef6b1"
format_stamp: "Formatted at 2026-02-01 08:59:33 on dist-test-slave-zz6f"
I20260201 08:59:33.884915 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260201 08:59:33.887926 20438 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:33.888612 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260201 08:59:33.888911 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/ts-2-root
uuid: "1d8a0e7216f2425d848f56d2a1cef6b1"
format_stamp: "Formatted at 2026-02-01 08:59:33 on dist-test-slave-zz6f"
I20260201 08:59:33.889122 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:33.900378 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:33.901481 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:33.903247 18612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:59:33.905776 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:59:33.905967 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:33.906226 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:59:33.906380 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:33.964329 20423 heartbeater.cc:499] Master 127.18.45.60:41717 was elected leader, sending a full tablet report...
I20260201 08:59:33.977926 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.3:33747
I20260201 08:59:33.978017 20500 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.3:33747 every 8 connection(s)
I20260201 08:59:33.998970 20502 heartbeater.cc:344] Connected to a master server at 127.18.45.61:37187
I20260201 08:59:33.999356 20502 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:34.000094 20501 heartbeater.cc:344] Connected to a master server at 127.18.45.60:41717
I20260201 08:59:34.000212 20502 heartbeater.cc:507] Master 127.18.45.61:37187 requested a full tablet report, sending...
I20260201 08:59:34.000511 20501 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:34.001348 20501 heartbeater.cc:507] Master 127.18.45.60:41717 requested a full tablet report, sending...
I20260201 08:59:34.002775 20503 heartbeater.cc:344] Connected to a master server at 127.18.45.62:34393
I20260201 08:59:34.003050 20119 ts_manager.cc:194] Registered new tserver with Master: 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 08:59:34.003126 20503 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:34.004096 20503 heartbeater.cc:507] Master 127.18.45.62:34393 requested a full tablet report, sending...
I20260201 08:59:34.005069 20184 ts_manager.cc:194] Registered new tserver with Master: 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 08:59:34.006347 20054 ts_manager.cc:194] Registered new tserver with Master: 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 08:59:34.006486 18612 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019952472s
I20260201 08:59:34.006642 20184 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57714
I20260201 08:59:34.051055 20184 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57722:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20260201 08:59:34.052520 20184 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260201 08:59:34.109125 20501 heartbeater.cc:499] Master 127.18.45.60:41717 was elected leader, sending a full tablet report...
I20260201 08:59:34.125502 20310 tablet_service.cc:1505] Processing CreateTablet for tablet d541aece5fc7448188615547b8e48598 (DEFAULT_TABLE table=test-table [id=f6b2fbdd3fad41339961f326c5cdddc7]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260201 08:59:34.125883 20309 tablet_service.cc:1505] Processing CreateTablet for tablet a4213e9edfbb4340b1674cb7549ff0e8 (DEFAULT_TABLE table=test-table [id=f6b2fbdd3fad41339961f326c5cdddc7]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260201 08:59:34.126768 20310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d541aece5fc7448188615547b8e48598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:34.126705 20466 tablet_service.cc:1505] Processing CreateTablet for tablet d541aece5fc7448188615547b8e48598 (DEFAULT_TABLE table=test-table [id=f6b2fbdd3fad41339961f326c5cdddc7]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260201 08:59:34.129381 20309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4213e9edfbb4340b1674cb7549ff0e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:34.129528 20466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d541aece5fc7448188615547b8e48598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:34.129504 20308 tablet_service.cc:1505] Processing CreateTablet for tablet 5e484bc43fd043a9b9c1311a444a4523 (DEFAULT_TABLE table=test-table [id=f6b2fbdd3fad41339961f326c5cdddc7]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260201 08:59:34.129043 20464 tablet_service.cc:1505] Processing CreateTablet for tablet 5e484bc43fd043a9b9c1311a444a4523 (DEFAULT_TABLE table=test-table [id=f6b2fbdd3fad41339961f326c5cdddc7]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260201 08:59:34.133728 20464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e484bc43fd043a9b9c1311a444a4523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:34.135968 20308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e484bc43fd043a9b9c1311a444a4523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:34.135573 20465 tablet_service.cc:1505] Processing CreateTablet for tablet a4213e9edfbb4340b1674cb7549ff0e8 (DEFAULT_TABLE table=test-table [id=f6b2fbdd3fad41339961f326c5cdddc7]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260201 08:59:34.140753 20465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4213e9edfbb4340b1674cb7549ff0e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:34.146310 20388 tablet_service.cc:1505] Processing CreateTablet for tablet d541aece5fc7448188615547b8e48598 (DEFAULT_TABLE table=test-table [id=f6b2fbdd3fad41339961f326c5cdddc7]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260201 08:59:34.148800 20387 tablet_service.cc:1505] Processing CreateTablet for tablet a4213e9edfbb4340b1674cb7549ff0e8 (DEFAULT_TABLE table=test-table [id=f6b2fbdd3fad41339961f326c5cdddc7]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260201 08:59:34.148730 20388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d541aece5fc7448188615547b8e48598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:34.150338 20387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4213e9edfbb4340b1674cb7549ff0e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:34.150147 20386 tablet_service.cc:1505] Processing CreateTablet for tablet 5e484bc43fd043a9b9c1311a444a4523 (DEFAULT_TABLE table=test-table [id=f6b2fbdd3fad41339961f326c5cdddc7]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260201 08:59:34.153791 20386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e484bc43fd043a9b9c1311a444a4523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:34.181077 20522 tablet_bootstrap.cc:492] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1: Bootstrap starting.
I20260201 08:59:34.191334 20524 tablet_bootstrap.cc:492] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5: Bootstrap starting.
I20260201 08:59:34.193163 20523 tablet_bootstrap.cc:492] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3: Bootstrap starting.
I20260201 08:59:34.195860 20522 tablet_bootstrap.cc:654] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:34.198944 20524 tablet_bootstrap.cc:654] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:34.201081 20523 tablet_bootstrap.cc:654] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:34.202142 20522 tablet_bootstrap.cc:492] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1: No bootstrap required, opened a new log
I20260201 08:59:34.202646 20522 ts_tablet_manager.cc:1403] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.005s
I20260201 08:59:34.204203 20524 tablet_bootstrap.cc:492] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5: No bootstrap required, opened a new log
I20260201 08:59:34.204722 20524 ts_tablet_manager.cc:1403] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.011s
I20260201 08:59:34.205520 20522 raft_consensus.cc:359] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.206264 20522 raft_consensus.cc:385] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:34.206573 20522 raft_consensus.cc:740] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d8a0e7216f2425d848f56d2a1cef6b1, State: Initialized, Role: FOLLOWER
I20260201 08:59:34.207261 20523 tablet_bootstrap.cc:492] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3: No bootstrap required, opened a new log
I20260201 08:59:34.207381 20522 consensus_queue.cc:260] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.207737 20524 raft_consensus.cc:359] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.208498 20524 raft_consensus.cc:385] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:34.208738 20524 raft_consensus.cc:740] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b54beaf2b694237916e31bea8d1a6a5, State: Initialized, Role: FOLLOWER
I20260201 08:59:34.207718 20523 ts_tablet_manager.cc:1403] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.008s
I20260201 08:59:34.209355 20524 consensus_queue.cc:260] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.216424 20523 raft_consensus.cc:359] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.217602 20523 raft_consensus.cc:385] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:34.219494 20524 ts_tablet_manager.cc:1434] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5: Time spent starting tablet: real 0.014s user 0.006s sys 0.005s
I20260201 08:59:34.219704 20523 raft_consensus.cc:740] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9e4e07649b441e9b1e9e5da9361cec3, State: Initialized, Role: FOLLOWER
I20260201 08:59:34.220578 20524 tablet_bootstrap.cc:492] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5: Bootstrap starting.
I20260201 08:59:34.220602 20523 consensus_queue.cc:260] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.223946 20522 ts_tablet_manager.cc:1434] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1: Time spent starting tablet: real 0.021s user 0.008s sys 0.011s
I20260201 08:59:34.224840 20522 tablet_bootstrap.cc:492] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1: Bootstrap starting.
I20260201 08:59:34.226406 20524 tablet_bootstrap.cc:654] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:34.230543 20522 tablet_bootstrap.cc:654] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:34.235246 20523 ts_tablet_manager.cc:1434] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3: Time spent starting tablet: real 0.025s user 0.007s sys 0.000s
I20260201 08:59:34.236402 20523 tablet_bootstrap.cc:492] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3: Bootstrap starting.
I20260201 08:59:34.241545 20528 raft_consensus.cc:493] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:34.242161 20528 raft_consensus.cc:515] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.245630 20522 tablet_bootstrap.cc:492] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1: No bootstrap required, opened a new log
I20260201 08:59:34.246074 20522 ts_tablet_manager.cc:1403] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.011s
I20260201 08:59:34.248605 20522 raft_consensus.cc:359] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.249291 20522 raft_consensus.cc:385] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:34.249580 20522 raft_consensus.cc:740] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d8a0e7216f2425d848f56d2a1cef6b1, State: Initialized, Role: FOLLOWER
I20260201 08:59:34.250404 20522 consensus_queue.cc:260] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.274096 20320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" is_pre_election: true
W20260201 08:59:34.276266 20439 leader_election.cc:343] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:34.289428 20528 leader_election.cc:290] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 08:59:34.293619 20535 raft_consensus.cc:493] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:34.296607 20535 raft_consensus.cc:515] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.294018 20523 tablet_bootstrap.cc:654] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:34.298254 20530 raft_consensus.cc:493] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:34.302098 20530 raft_consensus.cc:515] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.304935 20530 leader_election.cc:290] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 08:59:34.312954 20528 raft_consensus.cc:493] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:34.322556 20528 raft_consensus.cc:515] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.318344 20535 leader_election.cc:290] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 08:59:34.368371 20320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" is_pre_election: true
I20260201 08:59:34.370803 20528 leader_election.cc:290] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 08:59:34.377533 20398 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5" is_pre_election: true
I20260201 08:59:34.373514 20320 raft_consensus.cc:2468] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in term 0.
I20260201 08:59:34.373291 20476 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" is_pre_election: true
I20260201 08:59:34.380791 20476 raft_consensus.cc:2468] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b54beaf2b694237916e31bea8d1a6a5 in term 0.
I20260201 08:59:34.381062 20439 leader_election.cc:304] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1, d9e4e07649b441e9b1e9e5da9361cec3; no voters:
I20260201 08:59:34.382846 20524 tablet_bootstrap.cc:492] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5: No bootstrap required, opened a new log
I20260201 08:59:34.383654 20524 ts_tablet_manager.cc:1403] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5: Time spent bootstrapping tablet: real 0.163s user 0.052s sys 0.080s
I20260201 08:59:34.382992 20522 ts_tablet_manager.cc:1434] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1: Time spent starting tablet: real 0.137s user 0.021s sys 0.031s
I20260201 08:59:34.384641 20362 leader_election.cc:304] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1, 9b54beaf2b694237916e31bea8d1a6a5; no voters:
I20260201 08:59:34.388088 20535 raft_consensus.cc:2804] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:34.389096 20535 raft_consensus.cc:493] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260201 08:59:34.393141 20441 leader_election.cc:343] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:34.394256 20535 raft_consensus.cc:3060] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:34.394356 20441 leader_election.cc:304] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1; no voters: 9b54beaf2b694237916e31bea8d1a6a5, d9e4e07649b441e9b1e9e5da9361cec3
I20260201 08:59:34.387221 20528 raft_consensus.cc:2804] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:34.451673 20528 raft_consensus.cc:493] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:34.451922 20320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" is_pre_election: true
I20260201 08:59:34.452778 20320 raft_consensus.cc:2468] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b54beaf2b694237916e31bea8d1a6a5 in term 0.
I20260201 08:59:34.388490 20398 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5" is_pre_election: true
I20260201 08:59:34.453397 20535 raft_consensus.cc:515] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.389109 20522 tablet_bootstrap.cc:492] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1: Bootstrap starting.
I20260201 08:59:34.452070 20528 raft_consensus.cc:3060] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:34.454870 20524 raft_consensus.cc:359] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 08:59:34.396158 20534 raft_consensus.cc:2749] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:34.458710 20524 raft_consensus.cc:385] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:34.459895 20524 raft_consensus.cc:740] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b54beaf2b694237916e31bea8d1a6a5, State: Initialized, Role: FOLLOWER
I20260201 08:59:34.460345 20523 tablet_bootstrap.cc:492] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3: No bootstrap required, opened a new log
I20260201 08:59:34.460847 20523 ts_tablet_manager.cc:1403] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3: Time spent bootstrapping tablet: real 0.225s user 0.021s sys 0.002s
I20260201 08:59:34.460615 20524 consensus_queue.cc:260] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 08:59:34.463443 20524 ts_tablet_manager.cc:1434] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5: Time spent starting tablet: real 0.079s user 0.006s sys 0.025s
I20260201 08:59:34.465129 20535 leader_election.cc:290] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 1 election: Requested vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 08:59:34.465770 20320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3"
I20260201 08:59:34.466336 20320 raft_consensus.cc:3060] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:34.464648 20524 tablet_bootstrap.cc:492] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5: Bootstrap starting.
I20260201 08:59:34.466610 20476 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1"
I20260201 08:59:34.467767 20523 raft_consensus.cc:359] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.468968 20397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5" is_pre_election: true
I20260201 08:59:34.469599 20523 raft_consensus.cc:385] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:34.470726 20398 raft_consensus.cc:2393] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in current term 1: Already voted for candidate 9b54beaf2b694237916e31bea8d1a6a5 in this term.
I20260201 08:59:34.471872 20523 raft_consensus.cc:740] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9e4e07649b441e9b1e9e5da9361cec3, State: Initialized, Role: FOLLOWER
I20260201 08:59:34.474853 20523 consensus_queue.cc:260] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.477202 20523 ts_tablet_manager.cc:1434] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20260201 08:59:34.477618 20320 raft_consensus.cc:2468] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b54beaf2b694237916e31bea8d1a6a5 in term 1.
I20260201 08:59:34.479197 20361 leader_election.cc:304] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b54beaf2b694237916e31bea8d1a6a5, d9e4e07649b441e9b1e9e5da9361cec3; no voters:
I20260201 08:59:34.481881 20535 raft_consensus.cc:2804] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:34.482301 20535 raft_consensus.cc:697] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 1 LEADER]: Becoming Leader. State: Replica: 9b54beaf2b694237916e31bea8d1a6a5, State: Running, Role: LEADER
I20260201 08:59:34.478132 20523 tablet_bootstrap.cc:492] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3: Bootstrap starting.
I20260201 08:59:34.486964 20522 tablet_bootstrap.cc:654] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:34.483366 20535 consensus_queue.cc:237] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.489851 20528 raft_consensus.cc:515] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.492362 20476 raft_consensus.cc:2393] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b54beaf2b694237916e31bea8d1a6a5 in current term 1: Already voted for candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in this term.
I20260201 08:59:34.494251 20524 tablet_bootstrap.cc:654] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:34.504549 20475 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" is_pre_election: true
I20260201 08:59:34.506732 20398 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5"
I20260201 08:59:34.508065 20272 leader_election.cc:304] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9e4e07649b441e9b1e9e5da9361cec3; no voters: 1d8a0e7216f2425d848f56d2a1cef6b1, 9b54beaf2b694237916e31bea8d1a6a5
I20260201 08:59:34.509161 20528 leader_election.cc:290] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 1 election: Requested vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 08:59:34.509061 20530 raft_consensus.cc:2749] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:34.513978 20320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3"
I20260201 08:59:34.518913 20320 raft_consensus.cc:2393] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in current term 1: Already voted for candidate 9b54beaf2b694237916e31bea8d1a6a5 in this term.
I20260201 08:59:34.520862 20183 catalog_manager.cc:5654] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2). New cstate: current_term: 1 leader_uuid: "9b54beaf2b694237916e31bea8d1a6a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:34.524394 20439 leader_election.cc:304] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1; no voters: 9b54beaf2b694237916e31bea8d1a6a5, d9e4e07649b441e9b1e9e5da9361cec3
I20260201 08:59:34.526326 20523 tablet_bootstrap.cc:654] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:34.527616 20528 raft_consensus.cc:2749] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260201 08:59:34.530234 20235 catalog_manager.cc:1269] Loaded cluster ID: 56278e18ac6043958bcc9e9de47661ab
I20260201 08:59:34.530643 20235 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689: loading cluster ID for follower catalog manager: success
I20260201 08:59:34.532476 20522 tablet_bootstrap.cc:492] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1: No bootstrap required, opened a new log
I20260201 08:59:34.532930 20522 ts_tablet_manager.cc:1403] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1: Time spent bootstrapping tablet: real 0.144s user 0.022s sys 0.024s
I20260201 08:59:34.535748 20522 raft_consensus.cc:359] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 08:59:34.536366 20522 raft_consensus.cc:385] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:34.536628 20522 raft_consensus.cc:740] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d8a0e7216f2425d848f56d2a1cef6b1, State: Initialized, Role: FOLLOWER
I20260201 08:59:34.538579 20522 consensus_queue.cc:260] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 08:59:34.542342 20524 tablet_bootstrap.cc:492] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5: No bootstrap required, opened a new log
I20260201 08:59:34.542768 20524 ts_tablet_manager.cc:1403] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5: Time spent bootstrapping tablet: real 0.078s user 0.012s sys 0.019s
I20260201 08:59:34.549286 20535 raft_consensus.cc:493] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:34.557158 20535 raft_consensus.cc:515] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 08:59:34.576264 20528 raft_consensus.cc:493] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:34.576893 20528 raft_consensus.cc:515] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 08:59:34.578217 20530 raft_consensus.cc:493] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:34.578653 20530 raft_consensus.cc:515] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.576507 20522 ts_tablet_manager.cc:1434] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1: Time spent starting tablet: real 0.043s user 0.006s sys 0.000s
I20260201 08:59:34.606518 20319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" is_pre_election: true
I20260201 08:59:34.606964 20530 leader_election.cc:290] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
W20260201 08:59:34.614385 20439 leader_election.cc:343] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:34.617558 20398 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5" is_pre_election: true
W20260201 08:59:34.654201 20273 leader_election.cc:343] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:34.717207 20261 catalog_manager.cc:1269] Loaded cluster ID: 56278e18ac6043958bcc9e9de47661ab
I20260201 08:59:34.717598 20261 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2: loading cluster ID for follower catalog manager: success
I20260201 08:59:34.759179 20235 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689: acquiring CA information for follower catalog manager: success
I20260201 08:59:34.790263 20320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" is_pre_election: true
W20260201 08:59:34.791078 20320 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2) took 213 ms (client timeout 234 ms). Trace:
I20260201 08:59:34.752671 20261 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2: acquiring CA information for follower catalog manager: success
W20260201 08:59:34.791517 20320 rpcz_store.cc:269] 0201 08:59:34.577246 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:34.787759 (+210513us) service_pool.cc:225] Handling call
0201 08:59:34.791018 (+ 3259us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 08:59:34.792806 20535 leader_election.cc:290] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 08:59:34.799502 20545 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cdf47e38da57474fa9a1f6f8698dd6ec)
I20260201 08:59:34.799592 20398 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5" is_pre_election: true
I20260201 08:59:34.799983 20545 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:34.800172 20398 raft_consensus.cc:2468] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in term 0.
W20260201 08:59:34.787547 20273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.45.2:33763, user_credentials={real_user=slave}} blocked reactor thread for 167117us
I20260201 08:59:34.801405 20441 leader_election.cc:304] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1, 9b54beaf2b694237916e31bea8d1a6a5; no voters: d9e4e07649b441e9b1e9e5da9361cec3
I20260201 08:59:34.801720 20545 leader_election.cc:290] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0881025374f24934891bbdb80e59dbf2 (127.18.45.61:37187), cdf47e38da57474fa9a1f6f8698dd6ec (127.18.45.60:41717)
I20260201 08:59:34.802197 20534 raft_consensus.cc:2804] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:34.802260 20530 raft_consensus.cc:493] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:34.802557 20534 raft_consensus.cc:493] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:34.802920 20534 raft_consensus.cc:3060] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:34.802765 20530 raft_consensus.cc:515] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.804490 20530 leader_election.cc:290] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 08:59:34.794953 20528 leader_election.cc:290] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 08:59:34.794374 20475 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" is_pre_election: true
I20260201 08:59:34.807008 20523 tablet_bootstrap.cc:492] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3: No bootstrap required, opened a new log
I20260201 08:59:34.797683 20524 raft_consensus.cc:359] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.810577 20523 ts_tablet_manager.cc:1403] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3: Time spent bootstrapping tablet: real 0.333s user 0.011s sys 0.014s
I20260201 08:59:34.810456 20194 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c8e1752930448a8877eff36fdda0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" is_pre_election: true
I20260201 08:59:34.812680 20533 raft_consensus.cc:493] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:34.812845 20546 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cdf47e38da57474fa9a1f6f8698dd6ec)
I20260201 08:59:34.813189 20533 raft_consensus.cc:515] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.813360 20546 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:34.810636 20524 raft_consensus.cc:385] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:34.817728 20474 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" is_pre_election: true
I20260201 08:59:34.812678 20398 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5" is_pre_election: true
I20260201 08:59:34.826738 20064 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0881025374f24934891bbdb80e59dbf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "0c8e1752930448a8877eff36fdda0689" is_pre_election: true
I20260201 08:59:34.818918 20533 leader_election.cc:290] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 08:59:34.820055 20397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5" is_pre_election: true
I20260201 08:59:34.816342 20523 raft_consensus.cc:359] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 08:59:34.816984 20535 consensus_queue.cc:1048] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260201 08:59:34.828658 20523 raft_consensus.cc:385] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:34.828992 20523 raft_consensus.cc:740] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9e4e07649b441e9b1e9e5da9361cec3, State: Initialized, Role: FOLLOWER
I20260201 08:59:34.821799 20534 raft_consensus.cc:515] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 08:59:34.822451 20261 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260201 08:59:34.823242 20129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c8e1752930448a8877eff36fdda0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "0881025374f24934891bbdb80e59dbf2" is_pre_election: true
I20260201 08:59:34.833027 20474 raft_consensus.cc:2393] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b54beaf2b694237916e31bea8d1a6a5 in current term 1: Already voted for candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in this term.
I20260201 08:59:34.815171 20475 raft_consensus.cc:2468] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9e4e07649b441e9b1e9e5da9361cec3 in term 0.
I20260201 08:59:34.824651 20524 raft_consensus.cc:740] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b54beaf2b694237916e31bea8d1a6a5, State: Initialized, Role: FOLLOWER
I20260201 08:59:34.836766 20320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" is_pre_election: true
I20260201 08:59:34.835180 20397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5"
I20260201 08:59:34.846583 20397 raft_consensus.cc:3060] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:34.846472 20524 consensus_queue.cc:260] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.836268 20319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" is_pre_election: true
I20260201 08:59:34.821686 20235 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260201 08:59:34.830456 20529 consensus_queue.cc:1048] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:59:34.847640 20318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3"
I20260201 08:59:34.829691 20523 consensus_queue.cc:260] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 08:59:34.845643 20129 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8e1752930448a8877eff36fdda0689 in term 1.
I20260201 08:59:34.849735 20041 leader_election.cc:304] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0881025374f24934891bbdb80e59dbf2, 0c8e1752930448a8877eff36fdda0689; no voters: cdf47e38da57474fa9a1f6f8698dd6ec
I20260201 08:59:34.850391 20523 ts_tablet_manager.cc:1434] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3: Time spent starting tablet: real 0.039s user 0.006s sys 0.000s
I20260201 08:59:34.846539 20320 raft_consensus.cc:2468] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in term 1.
I20260201 08:59:34.822474 20476 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" is_pre_election: true
I20260201 08:59:34.852607 20272 leader_election.cc:304] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9e4e07649b441e9b1e9e5da9361cec3; no voters: 1d8a0e7216f2425d848f56d2a1cef6b1, 9b54beaf2b694237916e31bea8d1a6a5
I20260201 08:59:34.826947 20546 leader_election.cc:290] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c8e1752930448a8877eff36fdda0689 (127.18.45.62:34393), cdf47e38da57474fa9a1f6f8698dd6ec (127.18.45.60:41717)
I20260201 08:59:34.836603 20194 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0881025374f24934891bbdb80e59dbf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" is_pre_election: true
I20260201 08:59:34.854113 20530 raft_consensus.cc:2749] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:34.854686 20524 ts_tablet_manager.cc:1434] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5: Time spent starting tablet: real 0.312s user 0.005s sys 0.003s
I20260201 08:59:34.855103 20106 leader_election.cc:304] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0881025374f24934891bbdb80e59dbf2; no voters: 0c8e1752930448a8877eff36fdda0689, cdf47e38da57474fa9a1f6f8698dd6ec
I20260201 08:59:34.852134 20439 leader_election.cc:304] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1, d9e4e07649b441e9b1e9e5da9361cec3; no voters: 9b54beaf2b694237916e31bea8d1a6a5
I20260201 08:59:34.856083 20545 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:34.856513 20318 raft_consensus.cc:3060] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:34.858357 20546 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:34.860028 20397 raft_consensus.cc:2468] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in term 1.
I20260201 08:59:34.860996 20441 leader_election.cc:304] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1, 9b54beaf2b694237916e31bea8d1a6a5; no voters:
I20260201 08:59:34.861732 20528 raft_consensus.cc:2804] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:34.856534 20545 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cdf47e38da57474fa9a1f6f8698dd6ec)
I20260201 08:59:34.862773 20545 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 1 FOLLOWER]: Advancing to term 2
W20260201 08:59:34.864519 20475 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35682 (request call id 1) took 252 ms (client timeout 286 ms). Trace:
W20260201 08:59:34.864907 20475 rpcz_store.cc:269] 0201 08:59:34.612081 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:34.787981 (+175900us) service_pool.cc:225] Handling call
0201 08:59:34.864466 (+ 76485us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 08:59:34.866068 20272 leader_election.cc:304] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1, d9e4e07649b441e9b1e9e5da9361cec3; no voters: 9b54beaf2b694237916e31bea8d1a6a5
I20260201 08:59:34.866940 20530 raft_consensus.cc:2804] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:34.867288 20530 raft_consensus.cc:493] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:34.867585 20530 raft_consensus.cc:3060] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:34.869758 20318 raft_consensus.cc:2468] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in term 1.
I20260201 08:59:34.833724 20534 leader_election.cc:290] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 1 election: Requested vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 08:59:34.871820 20319 raft_consensus.cc:2393] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b54beaf2b694237916e31bea8d1a6a5 in current term 1: Already voted for candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in this term.
I20260201 08:59:34.872192 20528 raft_consensus.cc:697] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 1 LEADER]: Becoming Leader. State: Replica: 1d8a0e7216f2425d848f56d2a1cef6b1, State: Running, Role: LEADER
I20260201 08:59:34.872792 20361 leader_election.cc:304] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b54beaf2b694237916e31bea8d1a6a5; no voters: 1d8a0e7216f2425d848f56d2a1cef6b1, d9e4e07649b441e9b1e9e5da9361cec3
I20260201 08:59:34.873034 20528 consensus_queue.cc:237] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 08:59:34.873850 20529 raft_consensus.cc:2749] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:34.873739 20530 raft_consensus.cc:515] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.875463 20545 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:34.876930 20475 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1"
I20260201 08:59:34.877435 20475 raft_consensus.cc:3060] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:34.878407 20129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c8e1752930448a8877eff36fdda0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "0881025374f24934891bbdb80e59dbf2"
I20260201 08:59:34.878939 20129 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:34.879364 20545 leader_election.cc:290] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [CANDIDATE]: Term 2 election: Requested vote from peers 0881025374f24934891bbdb80e59dbf2 (127.18.45.61:37187), cdf47e38da57474fa9a1f6f8698dd6ec (127.18.45.60:41717)
I20260201 08:59:34.876168 20397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5"
I20260201 08:59:34.882091 20397 raft_consensus.cc:3060] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:34.883916 20129 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8e1752930448a8877eff36fdda0689 in term 2.
I20260201 08:59:34.885000 20194 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c8e1752930448a8877eff36fdda0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec"
I20260201 08:59:34.885243 20530 leader_election.cc:290] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 1 election: Requested vote from peers 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 08:59:34.886148 20041 leader_election.cc:304] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0881025374f24934891bbdb80e59dbf2, 0c8e1752930448a8877eff36fdda0689; no voters: cdf47e38da57474fa9a1f6f8698dd6ec
I20260201 08:59:34.886315 20533 raft_consensus.cc:2804] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:34.888422 20533 raft_consensus.cc:493] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b54beaf2b694237916e31bea8d1a6a5)
I20260201 08:59:34.888906 20533 raft_consensus.cc:3060] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:34.890187 20397 raft_consensus.cc:2468] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9e4e07649b441e9b1e9e5da9361cec3 in term 1.
I20260201 08:59:34.891258 20273 leader_election.cc:304] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b54beaf2b694237916e31bea8d1a6a5, d9e4e07649b441e9b1e9e5da9361cec3; no voters:
I20260201 08:59:34.892030 20475 raft_consensus.cc:2468] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9e4e07649b441e9b1e9e5da9361cec3 in term 1.
I20260201 08:59:34.893013 20530 raft_consensus.cc:2804] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:34.893961 20530 raft_consensus.cc:697] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 LEADER]: Becoming Leader. State: Replica: d9e4e07649b441e9b1e9e5da9361cec3, State: Running, Role: LEADER
I20260201 08:59:34.894642 20530 consensus_queue.cc:237] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.897125 20129 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 2 FOLLOWER]: Rejecting Update request from peer cdf47e38da57474fa9a1f6f8698dd6ec for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:34.898607 20296 consensus_queue.cc:1059] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 }, Status: INVALID_TERM, Last received: 1.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260201 08:59:34.899595 20237 raft_consensus.cc:3055] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:34.899914 20237 raft_consensus.cc:740] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cdf47e38da57474fa9a1f6f8698dd6ec, State: Running, Role: LEADER
I20260201 08:59:34.900621 20237 consensus_queue.cc:260] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:34.908004 20237 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:34.914485 20545 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 2 FOLLOWER]: Leader election won for term 2
W20260201 08:59:34.922853 20512 master_proxy_rpc.cc:203] Re-attempting IsCreateTableDone request to leader Master (127.18.45.60:41717)
I20260201 08:59:34.944940 20533 raft_consensus.cc:515] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.949594 20475 raft_consensus.cc:1240] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Rejecting Update request from peer 9b54beaf2b694237916e31bea8d1a6a5 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:34.952786 20397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5"
I20260201 08:59:34.953202 20319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3"
I20260201 08:59:34.953523 20545 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 2 LEADER]: Becoming Leader. State: Replica: 0c8e1752930448a8877eff36fdda0689, State: Running, Role: LEADER
I20260201 08:59:34.952932 20533 leader_election.cc:290] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 2 election: Requested vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 08:59:34.954372 20545 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:34.957018 20439 leader_election.cc:304] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1; no voters: 9b54beaf2b694237916e31bea8d1a6a5, d9e4e07649b441e9b1e9e5da9361cec3
I20260201 08:59:34.958148 20533 raft_consensus.cc:2749] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:34.964879 20556 consensus_queue.cc:1059] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:59:34.965426 20558 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c8e1752930448a8877eff36fdda0689. Latest consensus state: current_term: 2 leader_uuid: "0c8e1752930448a8877eff36fdda0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:34.965783 20556 raft_consensus.cc:3055] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:34.966086 20558 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [sys.catalog]: This master's current role is: LEADER
I20260201 08:59:34.966157 20556 raft_consensus.cc:740] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b54beaf2b694237916e31bea8d1a6a5, State: Running, Role: LEADER
I20260201 08:59:34.966552 20533 consensus_queue.cc:1048] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:34.967087 20556 consensus_queue.cc:260] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:34.968170 20556 raft_consensus.cc:3060] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:34.975888 20559 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 08:59:34.976220 20528 consensus_queue.cc:1048] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:34.987273 20559 catalog_manager.cc:679] Loaded metadata for table test-table [id=f6b2fbdd3fad41339961f326c5cdddc7]
I20260201 08:59:34.994813 20559 tablet_loader.cc:96] loaded metadata for tablet 5e484bc43fd043a9b9c1311a444a4523 (table test-table [id=f6b2fbdd3fad41339961f326c5cdddc7])
I20260201 08:59:34.996646 20559 tablet_loader.cc:96] loaded metadata for tablet a4213e9edfbb4340b1674cb7549ff0e8 (table test-table [id=f6b2fbdd3fad41339961f326c5cdddc7])
I20260201 08:59:34.998216 20559 tablet_loader.cc:96] loaded metadata for tablet d541aece5fc7448188615547b8e48598 (table test-table [id=f6b2fbdd3fad41339961f326c5cdddc7])
I20260201 08:59:34.999872 20559 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 08:59:35.005640 20559 catalog_manager.cc:1269] Loaded cluster ID: 56278e18ac6043958bcc9e9de47661ab
I20260201 08:59:35.006006 20559 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 08:59:35.010129 20530 consensus_queue.cc:1048] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:35.011845 20530 consensus_queue.cc:1048] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:35.019510 20559 catalog_manager.cc:1514] Loading token signing keys...
I20260201 08:59:35.029697 20559 catalog_manager.cc:6038] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689: Loaded TSK: 0
I20260201 08:59:35.030983 20559 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 08:59:35.047708 20054 catalog_manager.cc:5654] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1). New cstate: current_term: 1 leader_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } }
I20260201 08:59:35.059602 20194 raft_consensus.cc:1275] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 2 FOLLOWER]: Refusing update from remote peer 0c8e1752930448a8877eff36fdda0689: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260201 08:59:35.061022 20558 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260201 08:59:35.062140 20129 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 2 FOLLOWER]: Refusing update from remote peer 0c8e1752930448a8877eff36fdda0689: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260201 08:59:35.063228 20558 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260201 08:59:35.066519 20237 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c8e1752930448a8877eff36fdda0689. Latest consensus state: current_term: 2 leader_uuid: "0c8e1752930448a8877eff36fdda0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:35.067103 20237 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [sys.catalog]: This master's current role is: FOLLOWER
I20260201 08:59:35.069468 20546 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c8e1752930448a8877eff36fdda0689. Latest consensus state: current_term: 2 leader_uuid: "0c8e1752930448a8877eff36fdda0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:35.070118 20546 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [sys.catalog]: This master's current role is: FOLLOWER
I20260201 08:59:35.071985 20558 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "0c8e1752930448a8877eff36fdda0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:35.072583 20558 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [sys.catalog]: This master's current role is: LEADER
I20260201 08:59:35.078689 20569 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "0c8e1752930448a8877eff36fdda0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:35.079469 20569 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [sys.catalog]: This master's current role is: LEADER
I20260201 08:59:35.081872 20237 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "0c8e1752930448a8877eff36fdda0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:35.082576 20237 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [sys.catalog]: This master's current role is: FOLLOWER
I20260201 08:59:35.082437 20546 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "0c8e1752930448a8877eff36fdda0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:35.083156 20546 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [sys.catalog]: This master's current role is: FOLLOWER
I20260201 08:59:35.114602 20565 raft_consensus.cc:493] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b54beaf2b694237916e31bea8d1a6a5)
I20260201 08:59:35.115005 20565 raft_consensus.cc:515] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:35.116385 20565 leader_election.cc:290] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 08:59:35.117094 20397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5" is_pre_election: true
I20260201 08:59:35.117340 20475 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" is_pre_election: true
I20260201 08:59:35.117717 20397 raft_consensus.cc:2468] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9e4e07649b441e9b1e9e5da9361cec3 in term 2.
I20260201 08:59:35.117980 20475 raft_consensus.cc:2393] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d9e4e07649b441e9b1e9e5da9361cec3 in current term 2: Already voted for candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in this term.
I20260201 08:59:35.118688 20273 leader_election.cc:304] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b54beaf2b694237916e31bea8d1a6a5, d9e4e07649b441e9b1e9e5da9361cec3; no voters:
I20260201 08:59:35.119414 20565 raft_consensus.cc:2804] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:35.119714 20565 raft_consensus.cc:493] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b54beaf2b694237916e31bea8d1a6a5)
I20260201 08:59:35.119993 20565 raft_consensus.cc:3060] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:35.121285 20248 catalog_manager.cc:1612] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260201 08:59:35.124295 20565 raft_consensus.cc:515] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:35.125720 20565 leader_election.cc:290] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 2 election: Requested vote from peers 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 08:59:35.126425 20397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5"
I20260201 08:59:35.126626 20475 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1"
I20260201 08:59:35.127354 20475 raft_consensus.cc:2393] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d9e4e07649b441e9b1e9e5da9361cec3 in current term 2: Already voted for candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in this term.
I20260201 08:59:35.131017 20397 raft_consensus.cc:2468] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9e4e07649b441e9b1e9e5da9361cec3 in term 2.
I20260201 08:59:35.131734 20273 leader_election.cc:304] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b54beaf2b694237916e31bea8d1a6a5, d9e4e07649b441e9b1e9e5da9361cec3; no voters: 1d8a0e7216f2425d848f56d2a1cef6b1
I20260201 08:59:35.132241 20530 raft_consensus.cc:2804] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:35.132647 20530 raft_consensus.cc:697] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 2 LEADER]: Becoming Leader. State: Replica: d9e4e07649b441e9b1e9e5da9361cec3, State: Running, Role: LEADER
I20260201 08:59:35.133248 20347 heartbeater.cc:499] Master 127.18.45.62:34393 was elected leader, sending a full tablet report...
I20260201 08:59:35.133414 20530 consensus_queue.cc:237] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:35.142171 20051 catalog_manager.cc:5654] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 reported cstate change: term changed from 1 to 2, leader changed from 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2) to d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1). New cstate: current_term: 2 leader_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:35.143431 20051 catalog_manager.cc:5654] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3). New cstate: current_term: 1 leader_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } }
I20260201 08:59:35.176679 20503 heartbeater.cc:499] Master 127.18.45.62:34393 was elected leader, sending a full tablet report...
I20260201 08:59:35.178372 20425 heartbeater.cc:499] Master 127.18.45.62:34393 was elected leader, sending a full tablet report...
I20260201 08:59:35.223636 20528 raft_consensus.cc:493] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:35.224069 20528 raft_consensus.cc:515] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:35.225914 20528 leader_election.cc:290] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 08:59:35.227146 20320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" is_pre_election: true
I20260201 08:59:35.227309 20397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5" is_pre_election: true
I20260201 08:59:35.228032 20397 raft_consensus.cc:2468] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in term 2.
I20260201 08:59:35.229835 20441 leader_election.cc:304] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1, 9b54beaf2b694237916e31bea8d1a6a5; no voters: d9e4e07649b441e9b1e9e5da9361cec3
I20260201 08:59:35.230369 20475 raft_consensus.cc:1275] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Refusing update from remote peer d9e4e07649b441e9b1e9e5da9361cec3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:35.230967 20528 raft_consensus.cc:2804] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:35.231594 20530 consensus_queue.cc:1048] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:35.231312 20528 raft_consensus.cc:493] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:35.232411 20528 raft_consensus.cc:3060] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:35.238773 20528 raft_consensus.cc:515] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:35.240427 20475 raft_consensus.cc:1240] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 3 FOLLOWER]: Rejecting Update request from peer d9e4e07649b441e9b1e9e5da9361cec3 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260201 08:59:35.241360 20528 leader_election.cc:290] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 3 election: Requested vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 08:59:35.241945 20320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3"
I20260201 08:59:35.242172 20398 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5"
I20260201 08:59:35.242563 20565 consensus_queue.cc:1059] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:35.243260 20530 raft_consensus.cc:3055] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:35.243510 20397 raft_consensus.cc:1275] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 2 FOLLOWER]: Refusing update from remote peer d9e4e07649b441e9b1e9e5da9361cec3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:35.243664 20530 raft_consensus.cc:740] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d9e4e07649b441e9b1e9e5da9361cec3, State: Running, Role: LEADER
I20260201 08:59:35.243709 20439 leader_election.cc:304] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1; no voters: 9b54beaf2b694237916e31bea8d1a6a5, d9e4e07649b441e9b1e9e5da9361cec3
I20260201 08:59:35.244912 20528 raft_consensus.cc:2749] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 08:59:35.244736 20530 consensus_queue.cc:260] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:35.245846 20530 raft_consensus.cc:3060] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 2 FOLLOWER]: Advancing to term 3
W20260201 08:59:35.245683 20565 consensus_queue.cc:1175] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9b54beaf2b694237916e31bea8d1a6a5" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260201 08:59:35.409647 20565 raft_consensus.cc:493] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:35.410116 20565 raft_consensus.cc:515] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:35.411756 20565 leader_election.cc:290] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 08:59:35.412379 20397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5" is_pre_election: true
I20260201 08:59:35.412987 20397 raft_consensus.cc:2468] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9e4e07649b441e9b1e9e5da9361cec3 in term 2.
I20260201 08:59:35.414836 20273 leader_election.cc:304] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b54beaf2b694237916e31bea8d1a6a5, d9e4e07649b441e9b1e9e5da9361cec3; no voters:
I20260201 08:59:35.415207 20475 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" is_pre_election: true
I20260201 08:59:35.415800 20475 raft_consensus.cc:2468] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9e4e07649b441e9b1e9e5da9361cec3 in term 3.
I20260201 08:59:35.416741 20530 raft_consensus.cc:2804] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:35.417279 20530 raft_consensus.cc:493] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:35.417748 20530 raft_consensus.cc:3060] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:35.441642 20530 raft_consensus.cc:515] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:35.443598 20530 leader_election.cc:290] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 4 election: Requested vote from peers 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 08:59:35.443928 20397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5"
I20260201 08:59:35.444123 20475 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1"
I20260201 08:59:35.444469 20397 raft_consensus.cc:3060] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 2 FOLLOWER]: Advancing to term 4
I20260201 08:59:35.444659 20475 raft_consensus.cc:3060] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:35.450853 20397 raft_consensus.cc:2468] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9e4e07649b441e9b1e9e5da9361cec3 in term 4.
W20260201 08:59:35.451375 20299 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42464: Illegal state: replica d9e4e07649b441e9b1e9e5da9361cec3 is not leader of this config: current role FOLLOWER
I20260201 08:59:35.453466 20475 raft_consensus.cc:2468] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9e4e07649b441e9b1e9e5da9361cec3 in term 4.
I20260201 08:59:35.454890 20272 leader_election.cc:304] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1, d9e4e07649b441e9b1e9e5da9361cec3; no voters:
I20260201 08:59:35.455992 20530 raft_consensus.cc:2804] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:59:35.457510 20530 raft_consensus.cc:697] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 4 LEADER]: Becoming Leader. State: Replica: d9e4e07649b441e9b1e9e5da9361cec3, State: Running, Role: LEADER
I20260201 08:59:35.459275 20530 consensus_queue.cc:237] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:35.469089 20053 catalog_manager.cc:5654] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } health_report { overall_health: UNKNOWN } } }
W20260201 08:59:35.517361 20378 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:56768: Illegal state: replica 9b54beaf2b694237916e31bea8d1a6a5 is not leader of this config: current role FOLLOWER
W20260201 08:59:35.525768 20456 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35692: Illegal state: replica 1d8a0e7216f2425d848f56d2a1cef6b1 is not leader of this config: current role FOLLOWER
I20260201 08:59:35.560650 20475 raft_consensus.cc:1275] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: Refusing update from remote peer d9e4e07649b441e9b1e9e5da9361cec3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:59:35.562036 20530 consensus_queue.cc:1048] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:35.568476 20397 raft_consensus.cc:1275] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 4 FOLLOWER]: Refusing update from remote peer d9e4e07649b441e9b1e9e5da9361cec3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:59:35.593381 20583 consensus_queue.cc:1048] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260201 08:59:35.845996 20320 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523"
dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3"
from {username='slave'} at 127.0.0.1:42468
I20260201 08:59:35.846556 20320 raft_consensus.cc:591] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 LEADER]: Received request to step down
I20260201 08:59:35.846859 20320 raft_consensus.cc:3055] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:35.847131 20320 raft_consensus.cc:740] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d9e4e07649b441e9b1e9e5da9361cec3, State: Running, Role: LEADER
I20260201 08:59:35.847690 20320 consensus_queue.cc:260] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:35.848529 20320 raft_consensus.cc:3060] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:35.952445 20591 raft_consensus.cc:493] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d9e4e07649b441e9b1e9e5da9361cec3)
I20260201 08:59:35.952870 20591 raft_consensus.cc:515] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:35.954368 20591 leader_election.cc:290] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 08:59:35.955112 20320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" is_pre_election: true
I20260201 08:59:35.955370 20475 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" is_pre_election: true
I20260201 08:59:35.955623 20320 raft_consensus.cc:2468] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b54beaf2b694237916e31bea8d1a6a5 in term 2.
I20260201 08:59:35.956595 20361 leader_election.cc:304] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b54beaf2b694237916e31bea8d1a6a5, d9e4e07649b441e9b1e9e5da9361cec3; no voters: 1d8a0e7216f2425d848f56d2a1cef6b1
I20260201 08:59:35.957197 20591 raft_consensus.cc:2804] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:35.957499 20591 raft_consensus.cc:493] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d9e4e07649b441e9b1e9e5da9361cec3)
I20260201 08:59:35.957729 20591 raft_consensus.cc:3060] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:35.961648 20591 raft_consensus.cc:515] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:35.962906 20591 leader_election.cc:290] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 2 election: Requested vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 08:59:35.963593 20320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3"
I20260201 08:59:35.963752 20475 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1"
I20260201 08:59:35.967978 20320 raft_consensus.cc:2468] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b54beaf2b694237916e31bea8d1a6a5 in term 2.
I20260201 08:59:35.968770 20361 leader_election.cc:304] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b54beaf2b694237916e31bea8d1a6a5, d9e4e07649b441e9b1e9e5da9361cec3; no voters: 1d8a0e7216f2425d848f56d2a1cef6b1
I20260201 08:59:35.969437 20591 raft_consensus.cc:2804] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:35.969813 20591 raft_consensus.cc:697] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 2 LEADER]: Becoming Leader. State: Replica: 9b54beaf2b694237916e31bea8d1a6a5, State: Running, Role: LEADER
I20260201 08:59:35.970570 20591 consensus_queue.cc:237] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:35.977051 20053 catalog_manager.cc:5654] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 reported cstate change: term changed from 1 to 2, leader changed from d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1) to 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2). New cstate: current_term: 2 leader_uuid: "9b54beaf2b694237916e31bea8d1a6a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:36.028890 20528 raft_consensus.cc:493] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d9e4e07649b441e9b1e9e5da9361cec3)
I20260201 08:59:36.029424 20528 raft_consensus.cc:515] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:36.031098 20528 leader_election.cc:290] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 08:59:36.031704 20320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" is_pre_election: true
I20260201 08:59:36.032032 20398 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5" is_pre_election: true
I20260201 08:59:36.032423 20320 raft_consensus.cc:2393] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in current term 2: Already voted for candidate 9b54beaf2b694237916e31bea8d1a6a5 in this term.
I20260201 08:59:36.033389 20439 leader_election.cc:304] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1; no voters: 9b54beaf2b694237916e31bea8d1a6a5, d9e4e07649b441e9b1e9e5da9361cec3
I20260201 08:59:36.033972 20528 raft_consensus.cc:3060] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:36.039253 20528 raft_consensus.cc:2749] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:36.057341 20320 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8"
dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3"
from {username='slave'} at 127.0.0.1:42468
I20260201 08:59:36.057905 20320 raft_consensus.cc:591] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 4 LEADER]: Received request to step down
I20260201 08:59:36.058236 20320 raft_consensus.cc:3055] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 4 LEADER]: Stepping down as leader of term 4
I20260201 08:59:36.058542 20320 raft_consensus.cc:740] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d9e4e07649b441e9b1e9e5da9361cec3, State: Running, Role: LEADER
I20260201 08:59:36.059242 20320 consensus_queue.cc:260] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:36.060376 20320 raft_consensus.cc:3060] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:36.062906 20320 raft_consensus.cc:1275] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 2 FOLLOWER]: Refusing update from remote peer 9b54beaf2b694237916e31bea8d1a6a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260201 08:59:36.063838 20591 consensus_queue.cc:1048] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:36.072748 20475 raft_consensus.cc:1275] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Refusing update from remote peer 9b54beaf2b694237916e31bea8d1a6a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260201 08:59:36.074697 20591 consensus_queue.cc:1048] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:59:36.151522 20528 raft_consensus.cc:493] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d9e4e07649b441e9b1e9e5da9361cec3)
I20260201 08:59:36.151891 20528 raft_consensus.cc:515] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:36.153090 20528 leader_election.cc:290] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 08:59:36.153690 20320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" is_pre_election: true
I20260201 08:59:36.153807 20398 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5" is_pre_election: true
I20260201 08:59:36.154137 20320 raft_consensus.cc:2468] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in term 5.
I20260201 08:59:36.154922 20439 leader_election.cc:304] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1, d9e4e07649b441e9b1e9e5da9361cec3; no voters: 9b54beaf2b694237916e31bea8d1a6a5
I20260201 08:59:36.155500 20528 raft_consensus.cc:2804] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:36.155807 20528 raft_consensus.cc:493] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d9e4e07649b441e9b1e9e5da9361cec3)
I20260201 08:59:36.156069 20528 raft_consensus.cc:3060] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:36.160234 20528 raft_consensus.cc:515] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:36.161696 20528 leader_election.cc:290] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 5 election: Requested vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 08:59:36.162457 20320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3"
I20260201 08:59:36.162674 20398 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5"
I20260201 08:59:36.166909 20320 raft_consensus.cc:2468] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in term 5.
I20260201 08:59:36.167721 20439 leader_election.cc:304] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1, d9e4e07649b441e9b1e9e5da9361cec3; no voters: 9b54beaf2b694237916e31bea8d1a6a5
I20260201 08:59:36.168362 20528 raft_consensus.cc:2804] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 5 FOLLOWER]: Leader election won for term 5
I20260201 08:59:36.168782 20528 raft_consensus.cc:697] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 5 LEADER]: Becoming Leader. State: Replica: 1d8a0e7216f2425d848f56d2a1cef6b1, State: Running, Role: LEADER
I20260201 08:59:36.169572 20528 consensus_queue.cc:237] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:36.173583 20596 raft_consensus.cc:493] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d9e4e07649b441e9b1e9e5da9361cec3)
I20260201 08:59:36.174034 20596 raft_consensus.cc:515] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:36.176256 20596 leader_election.cc:290] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 08:59:36.176777 20475 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" is_pre_election: true
I20260201 08:59:36.176707 20051 catalog_manager.cc:5654] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 reported cstate change: term changed from 4 to 5, leader changed from d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1) to 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3). New cstate: current_term: 5 leader_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:36.178514 20320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" is_pre_election: true
I20260201 08:59:36.179266 20320 raft_consensus.cc:2393] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b54beaf2b694237916e31bea8d1a6a5 in current term 5: Already voted for candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in this term.
I20260201 08:59:36.180290 20361 leader_election.cc:304] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b54beaf2b694237916e31bea8d1a6a5; no voters: 1d8a0e7216f2425d848f56d2a1cef6b1, d9e4e07649b441e9b1e9e5da9361cec3
I20260201 08:59:36.181392 20591 raft_consensus.cc:3060] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:36.198240 20591 raft_consensus.cc:2749] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:36.250665 20398 raft_consensus.cc:1275] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 5 FOLLOWER]: Refusing update from remote peer 1d8a0e7216f2425d848f56d2a1cef6b1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260201 08:59:36.251768 20528 consensus_queue.cc:1048] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:36.281837 20320 raft_consensus.cc:1275] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 5 FOLLOWER]: Refusing update from remote peer 1d8a0e7216f2425d848f56d2a1cef6b1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260201 08:59:36.283233 20528 consensus_queue.cc:1048] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:36.290853 20398 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523"
dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5"
from {username='slave'} at 127.0.0.1:56774
I20260201 08:59:36.291318 20398 raft_consensus.cc:591] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 2 LEADER]: Received request to step down
I20260201 08:59:36.291620 20398 raft_consensus.cc:3055] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:36.291879 20398 raft_consensus.cc:740] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b54beaf2b694237916e31bea8d1a6a5, State: Running, Role: LEADER
I20260201 08:59:36.292524 20398 consensus_queue.cc:260] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:36.293591 20398 raft_consensus.cc:3060] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:36.481230 20585 raft_consensus.cc:493] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b54beaf2b694237916e31bea8d1a6a5)
I20260201 08:59:36.481913 20585 raft_consensus.cc:515] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:36.482769 20528 raft_consensus.cc:493] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b54beaf2b694237916e31bea8d1a6a5)
I20260201 08:59:36.483249 20528 raft_consensus.cc:515] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:36.483691 20585 leader_election.cc:290] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 08:59:36.484627 20398 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5" is_pre_election: true
I20260201 08:59:36.485306 20475 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" is_pre_election: true
I20260201 08:59:36.485646 20398 raft_consensus.cc:2468] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9e4e07649b441e9b1e9e5da9361cec3 in term 3.
I20260201 08:59:36.485896 20475 raft_consensus.cc:2468] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9e4e07649b441e9b1e9e5da9361cec3 in term 2.
I20260201 08:59:36.486599 20320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" is_pre_election: true
I20260201 08:59:36.485910 20528 leader_election.cc:290] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 08:59:36.487191 20320 raft_consensus.cc:2468] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in term 2.
I20260201 08:59:36.487201 20272 leader_election.cc:304] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1, d9e4e07649b441e9b1e9e5da9361cec3; no voters:
I20260201 08:59:36.487370 20398 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5" is_pre_election: true
I20260201 08:59:36.488070 20585 raft_consensus.cc:2804] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:36.488023 20398 raft_consensus.cc:2468] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in term 3.
I20260201 08:59:36.488533 20585 raft_consensus.cc:493] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b54beaf2b694237916e31bea8d1a6a5)
I20260201 08:59:36.488565 20439 leader_election.cc:304] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1, d9e4e07649b441e9b1e9e5da9361cec3; no voters:
I20260201 08:59:36.489069 20585 raft_consensus.cc:3060] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:36.489480 20528 raft_consensus.cc:2804] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:36.489881 20528 raft_consensus.cc:493] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b54beaf2b694237916e31bea8d1a6a5)
I20260201 08:59:36.490150 20528 raft_consensus.cc:3060] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:36.494393 20585 raft_consensus.cc:515] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:36.494568 20528 raft_consensus.cc:515] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:36.496659 20528 leader_election.cc:290] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 3 election: Requested vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 08:59:36.496695 20585 leader_election.cc:290] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 3 election: Requested vote from peers 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 08:59:36.498131 20475 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1"
I20260201 08:59:36.498931 20475 raft_consensus.cc:2393] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d9e4e07649b441e9b1e9e5da9361cec3 in current term 3: Already voted for candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in this term.
I20260201 08:59:36.498951 20398 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5"
I20260201 08:59:36.508682 20320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3"
I20260201 08:59:36.510192 20320 raft_consensus.cc:2393] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in current term 3: Already voted for candidate d9e4e07649b441e9b1e9e5da9361cec3 in this term.
I20260201 08:59:36.511435 20397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5"
I20260201 08:59:36.511987 20398 raft_consensus.cc:2468] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9e4e07649b441e9b1e9e5da9361cec3 in term 3.
I20260201 08:59:36.513584 20273 leader_election.cc:304] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b54beaf2b694237916e31bea8d1a6a5, d9e4e07649b441e9b1e9e5da9361cec3; no voters: 1d8a0e7216f2425d848f56d2a1cef6b1
I20260201 08:59:36.513870 20441 leader_election.cc:304] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1; no voters: 9b54beaf2b694237916e31bea8d1a6a5, d9e4e07649b441e9b1e9e5da9361cec3
I20260201 08:59:36.514627 20585 raft_consensus.cc:2804] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:36.515065 20528 raft_consensus.cc:2749] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 08:59:36.516134 20585 raft_consensus.cc:697] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 3 LEADER]: Becoming Leader. State: Replica: d9e4e07649b441e9b1e9e5da9361cec3, State: Running, Role: LEADER
I20260201 08:59:36.517130 20585 consensus_queue.cc:237] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:36.524788 20051 catalog_manager.cc:5654] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 reported cstate change: term changed from 2 to 3, leader changed from 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2) to d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1). New cstate: current_term: 3 leader_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:36.526086 20475 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d541aece5fc7448188615547b8e48598"
dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1"
from {username='slave'} at 127.0.0.1:35698
I20260201 08:59:36.526805 20475 raft_consensus.cc:591] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 1 LEADER]: Received request to step down
I20260201 08:59:36.527140 20475 raft_consensus.cc:3055] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:36.527415 20475 raft_consensus.cc:740] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1d8a0e7216f2425d848f56d2a1cef6b1, State: Running, Role: LEADER
I20260201 08:59:36.528254 20475 consensus_queue.cc:260] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 08:59:36.529211 20475 raft_consensus.cc:3060] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:36.602065 20398 raft_consensus.cc:1275] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 3 FOLLOWER]: Refusing update from remote peer d9e4e07649b441e9b1e9e5da9361cec3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260201 08:59:36.602981 20585 consensus_queue.cc:1048] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:36.618212 20475 raft_consensus.cc:1275] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 3 FOLLOWER]: Refusing update from remote peer d9e4e07649b441e9b1e9e5da9361cec3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260201 08:59:36.620941 20585 consensus_queue.cc:1048] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:36.653360 20585 raft_consensus.cc:493] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d8a0e7216f2425d848f56d2a1cef6b1)
I20260201 08:59:36.653752 20585 raft_consensus.cc:515] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 08:59:36.655078 20585 leader_election.cc:290] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 08:59:36.655687 20475 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" is_pre_election: true
I20260201 08:59:36.655908 20398 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5" is_pre_election: true
I20260201 08:59:36.656234 20475 raft_consensus.cc:2468] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9e4e07649b441e9b1e9e5da9361cec3 in term 2.
I20260201 08:59:36.657140 20272 leader_election.cc:304] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1, d9e4e07649b441e9b1e9e5da9361cec3; no voters: 9b54beaf2b694237916e31bea8d1a6a5
I20260201 08:59:36.657680 20585 raft_consensus.cc:2804] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:36.658006 20585 raft_consensus.cc:493] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1d8a0e7216f2425d848f56d2a1cef6b1)
I20260201 08:59:36.658260 20585 raft_consensus.cc:3060] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:36.662170 20585 raft_consensus.cc:515] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 08:59:36.663595 20585 leader_election.cc:290] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 2 election: Requested vote from peers 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 08:59:36.664188 20475 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1"
I20260201 08:59:36.664556 20398 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5"
I20260201 08:59:36.668989 20475 raft_consensus.cc:2468] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9e4e07649b441e9b1e9e5da9361cec3 in term 2.
I20260201 08:59:36.669723 20272 leader_election.cc:304] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1, d9e4e07649b441e9b1e9e5da9361cec3; no voters: 9b54beaf2b694237916e31bea8d1a6a5
I20260201 08:59:36.670307 20585 raft_consensus.cc:2804] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:36.670722 20585 raft_consensus.cc:697] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 2 LEADER]: Becoming Leader. State: Replica: d9e4e07649b441e9b1e9e5da9361cec3, State: Running, Role: LEADER
I20260201 08:59:36.671500 20585 consensus_queue.cc:237] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 08:59:36.674517 20591 raft_consensus.cc:493] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d8a0e7216f2425d848f56d2a1cef6b1)
I20260201 08:59:36.675007 20591 raft_consensus.cc:515] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 08:59:36.677819 20591 leader_election.cc:290] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 08:59:36.678542 20320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" is_pre_election: true
I20260201 08:59:36.678483 20053 catalog_manager.cc:5654] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 reported cstate change: term changed from 1 to 2, leader changed from 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3) to d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1). New cstate: current_term: 2 leader_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:36.680042 20475 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" is_pre_election: true
I20260201 08:59:36.680649 20475 raft_consensus.cc:2393] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b54beaf2b694237916e31bea8d1a6a5 in current term 2: Already voted for candidate d9e4e07649b441e9b1e9e5da9361cec3 in this term.
I20260201 08:59:36.681576 20362 leader_election.cc:304] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b54beaf2b694237916e31bea8d1a6a5; no voters: 1d8a0e7216f2425d848f56d2a1cef6b1, d9e4e07649b441e9b1e9e5da9361cec3
I20260201 08:59:36.682264 20591 raft_consensus.cc:3060] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:36.687716 20591 raft_consensus.cc:2749] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:36.738489 20475 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8"
dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1"
from {username='slave'} at 127.0.0.1:35698
I20260201 08:59:36.739135 20475 raft_consensus.cc:591] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 5 LEADER]: Received request to step down
I20260201 08:59:36.739691 20475 raft_consensus.cc:3055] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 5 LEADER]: Stepping down as leader of term 5
I20260201 08:59:36.740047 20475 raft_consensus.cc:740] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1d8a0e7216f2425d848f56d2a1cef6b1, State: Running, Role: LEADER
I20260201 08:59:36.740953 20475 consensus_queue.cc:260] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:36.741941 20475 raft_consensus.cc:3060] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:36.777680 20475 raft_consensus.cc:1275] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Refusing update from remote peer d9e4e07649b441e9b1e9e5da9361cec3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260201 08:59:36.778692 20602 consensus_queue.cc:1048] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:36.787606 20398 raft_consensus.cc:1275] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 2 FOLLOWER]: Refusing update from remote peer d9e4e07649b441e9b1e9e5da9361cec3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260201 08:59:36.794250 20604 consensus_queue.cc:1048] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:36.866605 20602 raft_consensus.cc:493] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1d8a0e7216f2425d848f56d2a1cef6b1)
I20260201 08:59:36.867039 20602 raft_consensus.cc:515] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:36.868427 20602 leader_election.cc:290] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 08:59:36.869182 20398 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5" is_pre_election: true
I20260201 08:59:36.869287 20475 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" is_pre_election: true
I20260201 08:59:36.869841 20475 raft_consensus.cc:2468] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9e4e07649b441e9b1e9e5da9361cec3 in term 6.
I20260201 08:59:36.870661 20272 leader_election.cc:304] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1, d9e4e07649b441e9b1e9e5da9361cec3; no voters: 9b54beaf2b694237916e31bea8d1a6a5
I20260201 08:59:36.871250 20602 raft_consensus.cc:2804] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 08:59:36.871676 20602 raft_consensus.cc:493] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1d8a0e7216f2425d848f56d2a1cef6b1)
I20260201 08:59:36.872066 20602 raft_consensus.cc:3060] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:36.876724 20602 raft_consensus.cc:515] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:36.878160 20602 leader_election.cc:290] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 6 election: Requested vote from peers 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 08:59:36.878952 20398 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5"
I20260201 08:59:36.879089 20475 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1"
I20260201 08:59:36.883473 20475 raft_consensus.cc:2468] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9e4e07649b441e9b1e9e5da9361cec3 in term 6.
I20260201 08:59:36.884413 20272 leader_election.cc:304] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1, d9e4e07649b441e9b1e9e5da9361cec3; no voters: 9b54beaf2b694237916e31bea8d1a6a5
I20260201 08:59:36.885179 20602 raft_consensus.cc:2804] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 6 FOLLOWER]: Leader election won for term 6
I20260201 08:59:36.885524 20602 raft_consensus.cc:697] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 6 LEADER]: Becoming Leader. State: Replica: d9e4e07649b441e9b1e9e5da9361cec3, State: Running, Role: LEADER
I20260201 08:59:36.886301 20602 consensus_queue.cc:237] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:36.893144 20051 catalog_manager.cc:5654] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 reported cstate change: term changed from 5 to 6, leader changed from 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3) to d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1). New cstate: current_term: 6 leader_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:36.904599 20591 raft_consensus.cc:493] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1d8a0e7216f2425d848f56d2a1cef6b1)
I20260201 08:59:36.905145 20591 raft_consensus.cc:515] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 08:59:36.907001 20591 leader_election.cc:290] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 08:59:36.910189 20320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" is_pre_election: true
I20260201 08:59:36.916481 20475 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" is_pre_election: true
I20260201 08:59:36.917268 20475 raft_consensus.cc:2393] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b54beaf2b694237916e31bea8d1a6a5 in current term 6: Already voted for candidate d9e4e07649b441e9b1e9e5da9361cec3 in this term.
I20260201 08:59:36.918200 20362 leader_election.cc:304] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b54beaf2b694237916e31bea8d1a6a5; no voters: 1d8a0e7216f2425d848f56d2a1cef6b1, d9e4e07649b441e9b1e9e5da9361cec3
I20260201 08:59:36.919476 20591 raft_consensus.cc:3060] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:36.924485 20591 raft_consensus.cc:2749] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 08:59:36.947614 20053 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40856:
table { table_id: "f6b2fbdd3fad41339961f326c5cdddc7" table_name: "test-table" } new_table_name: "NewTableName"
I20260201 08:59:36.972616 18612 master.cc:561] Master@127.18.45.62:34393 shutting down...
I20260201 08:59:36.991853 20398 raft_consensus.cc:1275] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 6 FOLLOWER]: Refusing update from remote peer d9e4e07649b441e9b1e9e5da9361cec3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260201 08:59:36.993597 20604 consensus_queue.cc:1048] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260201 08:59:37.000566 20474 raft_consensus.cc:1275] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 6 FOLLOWER]: Refusing update from remote peer d9e4e07649b441e9b1e9e5da9361cec3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260201 08:59:37.007599 20601 consensus_queue.cc:1048] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260201 08:59:37.009864 20610 tablet.cc:1722] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260201 08:59:37.023044 20615 tablet.cc:1722] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260201 08:59:37.037804 20617 tablet.cc:1722] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260201 08:59:37.039232 20614 tablet.cc:1722] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260201 08:59:37.057623 20618 tablet.cc:1722] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260201 08:59:37.065339 20613 tablet.cc:1722] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260201 08:59:37.067701 20612 tablet.cc:1722] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260201 08:59:37.068740 20616 tablet.cc:1722] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260201 08:59:37.070206 20611 tablet.cc:1722] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260201 08:59:37.118925 18612 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:37.119922 18612 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:37.120322 18612 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689: stopping tablet replica
I20260201 08:59:37.142304 18612 master.cc:583] Master@127.18.45.62:34393 shutdown complete.
I20260201 08:59:37.259397 20622 raft_consensus.cc:493] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c8e1752930448a8877eff36fdda0689)
I20260201 08:59:37.259909 20622 raft_consensus.cc:515] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:37.261476 20622 leader_election.cc:290] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c8e1752930448a8877eff36fdda0689 (127.18.45.62:34393), 0881025374f24934891bbdb80e59dbf2 (127.18.45.61:37187)
I20260201 08:59:37.262535 20129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 17 } } ignore_live_leader: false dest_uuid: "0881025374f24934891bbdb80e59dbf2" is_pre_election: true
W20260201 08:59:37.265940 20169 leader_election.cc:336] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c8e1752930448a8877eff36fdda0689 (127.18.45.62:34393): Network error: Client connection negotiation failed: client connection to 127.18.45.62:34393: connect: Connection refused (error 111)
I20260201 08:59:37.266321 20169 leader_election.cc:304] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cdf47e38da57474fa9a1f6f8698dd6ec; no voters: 0881025374f24934891bbdb80e59dbf2, 0c8e1752930448a8877eff36fdda0689
I20260201 08:59:37.266913 20622 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:37.280802 20625 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c8e1752930448a8877eff36fdda0689)
I20260201 08:59:37.281224 20625 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:37.282663 20625 leader_election.cc:290] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c8e1752930448a8877eff36fdda0689 (127.18.45.62:34393), cdf47e38da57474fa9a1f6f8698dd6ec (127.18.45.60:41717)
I20260201 08:59:37.283730 20194 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0881025374f24934891bbdb80e59dbf2" candidate_term: 3 candidate_status { last_received { term: 2 index: 17 } } ignore_live_leader: false dest_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" is_pre_election: true
I20260201 08:59:37.284250 20194 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0881025374f24934891bbdb80e59dbf2 in term 2.
I20260201 08:59:37.285393 20106 leader_election.cc:304] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0881025374f24934891bbdb80e59dbf2, cdf47e38da57474fa9a1f6f8698dd6ec; no voters:
I20260201 08:59:37.286265 20625 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:37.286623 20625 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c8e1752930448a8877eff36fdda0689)
I20260201 08:59:37.286916 20625 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 2 FOLLOWER]: Advancing to term 3
W20260201 08:59:37.287951 20105 leader_election.cc:336] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c8e1752930448a8877eff36fdda0689 (127.18.45.62:34393): Network error: Client connection negotiation failed: client connection to 127.18.45.62:34393: connect: Connection refused (error 111)
I20260201 08:59:37.292682 20625 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:37.294160 20625 leader_election.cc:290] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [CANDIDATE]: Term 3 election: Requested vote from peers 0c8e1752930448a8877eff36fdda0689 (127.18.45.62:34393), cdf47e38da57474fa9a1f6f8698dd6ec (127.18.45.60:41717)
I20260201 08:59:37.295087 20194 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0881025374f24934891bbdb80e59dbf2" candidate_term: 3 candidate_status { last_received { term: 2 index: 17 } } ignore_live_leader: false dest_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec"
I20260201 08:59:37.295605 20194 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 2 FOLLOWER]: Advancing to term 3
W20260201 08:59:37.297972 20105 leader_election.cc:336] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0c8e1752930448a8877eff36fdda0689 (127.18.45.62:34393): Network error: Client connection negotiation failed: client connection to 127.18.45.62:34393: connect: Connection refused (error 111)
I20260201 08:59:37.300470 20194 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0881025374f24934891bbdb80e59dbf2 in term 3.
I20260201 08:59:37.301299 20106 leader_election.cc:304] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0881025374f24934891bbdb80e59dbf2, cdf47e38da57474fa9a1f6f8698dd6ec; no voters: 0c8e1752930448a8877eff36fdda0689
I20260201 08:59:37.301868 20625 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:37.302810 20625 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 3 LEADER]: Becoming Leader. State: Replica: 0881025374f24934891bbdb80e59dbf2, State: Running, Role: LEADER
I20260201 08:59:37.303429 20625 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 2.17, Last appended by leader: 17, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:37.307492 20628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0881025374f24934891bbdb80e59dbf2. Latest consensus state: current_term: 3 leader_uuid: "0881025374f24934891bbdb80e59dbf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:37.308281 20628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [sys.catalog]: This master's current role is: LEADER
I20260201 08:59:37.309942 20629 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 08:59:37.316011 20629 catalog_manager.cc:679] Loaded metadata for table NewTableName [id=f6b2fbdd3fad41339961f326c5cdddc7]
I20260201 08:59:37.320626 20629 tablet_loader.cc:96] loaded metadata for tablet 5e484bc43fd043a9b9c1311a444a4523 (table NewTableName [id=f6b2fbdd3fad41339961f326c5cdddc7])
I20260201 08:59:37.321938 20629 tablet_loader.cc:96] loaded metadata for tablet a4213e9edfbb4340b1674cb7549ff0e8 (table NewTableName [id=f6b2fbdd3fad41339961f326c5cdddc7])
I20260201 08:59:37.323254 20629 tablet_loader.cc:96] loaded metadata for tablet d541aece5fc7448188615547b8e48598 (table NewTableName [id=f6b2fbdd3fad41339961f326c5cdddc7])
I20260201 08:59:37.324388 20629 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 08:59:37.328312 20629 catalog_manager.cc:1269] Loaded cluster ID: 56278e18ac6043958bcc9e9de47661ab
I20260201 08:59:37.328517 20629 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 08:59:37.332767 20629 catalog_manager.cc:1514] Loading token signing keys...
I20260201 08:59:37.336103 20629 catalog_manager.cc:6038] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2: Loaded TSK: 0
I20260201 08:59:37.336979 20629 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 08:59:37.357481 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:37.362773 20630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:37.363232 20631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:37.364630 20633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:37.365229 18612 server_base.cc:1060] running on GCE node
I20260201 08:59:37.366677 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:37.366887 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:37.367058 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936377367042 us; error 0 us; skew 500 ppm
I20260201 08:59:37.367543 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:37.370695 18612 webserver.cc:492] Webserver started at http://127.18.45.62:43385/ using document root <none> and password file <none>
I20260201 08:59:37.371181 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:37.371431 18612 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260201 08:59:37.374810 18612 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260201 08:59:37.377347 20638 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:37.377971 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260201 08:59:37.378261 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/master-0-root
uuid: "0c8e1752930448a8877eff36fdda0689"
format_stamp: "Formatted at 2026-02-01 08:59:33 on dist-test-slave-zz6f"
I20260201 08:59:37.378604 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:37.409706 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
W20260201 08:59:37.410429 20105 consensus_peers.cc:597] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 -> Peer 0c8e1752930448a8877eff36fdda0689 (127.18.45.62:34393): Couldn't send request to peer 0c8e1752930448a8877eff36fdda0689. Status: Network error: Client connection negotiation failed: client connection to 127.18.45.62:34393: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:37.411269 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:37.427026 20194 raft_consensus.cc:1275] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 3 FOLLOWER]: Refusing update from remote peer 0881025374f24934891bbdb80e59dbf2: Log matching property violated. Preceding OpId in replica: term: 2 index: 17. Preceding OpId from leader: term: 3 index: 18. (index mismatch)
I20260201 08:59:37.429353 20628 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260201 08:59:37.433146 20622 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0881025374f24934891bbdb80e59dbf2. Latest consensus state: current_term: 3 leader_uuid: "0881025374f24934891bbdb80e59dbf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:37.433890 20622 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [sys.catalog]: This master's current role is: FOLLOWER
I20260201 08:59:37.439846 20625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "0881025374f24934891bbdb80e59dbf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:37.440649 20625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [sys.catalog]: This master's current role is: LEADER
I20260201 08:59:37.440605 20622 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "0881025374f24934891bbdb80e59dbf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:37.441759 20622 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [sys.catalog]: This master's current role is: FOLLOWER
I20260201 08:59:37.468652 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.62:34393
I20260201 08:59:37.468747 20690 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.62:34393 every 8 connection(s)
I20260201 08:59:37.477391 20691 sys_catalog.cc:263] Verifying existing consensus state
I20260201 08:59:37.483115 20691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689: Bootstrap starting.
I20260201 08:59:37.520694 20502 heartbeater.cc:499] Master 127.18.45.61:37187 was elected leader, sending a full tablet report...
I20260201 08:59:37.527115 20503 heartbeater.cc:344] Connected to a master server at 127.18.45.62:34393
I20260201 08:59:37.532058 20424 heartbeater.cc:499] Master 127.18.45.61:37187 was elected leader, sending a full tablet report...
I20260201 08:59:37.532815 20346 heartbeater.cc:499] Master 127.18.45.61:37187 was elected leader, sending a full tablet report...
I20260201 08:59:37.553167 20347 heartbeater.cc:344] Connected to a master server at 127.18.45.62:34393
I20260201 08:59:37.553494 20691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=0 applied=17 ignored=0} inserts{seen=7 ignored=0} mutations{seen=14 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:37.554666 20691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689: Bootstrap complete.
I20260201 08:59:37.557680 20425 heartbeater.cc:344] Connected to a master server at 127.18.45.62:34393
I20260201 08:59:37.557709 20691 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:37.558833 20691 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8e1752930448a8877eff36fdda0689, State: Initialized, Role: FOLLOWER
I20260201 08:59:37.559500 20691 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 2.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:37.563470 20698 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:37.564178 20698 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [sys.catalog]: This master's current role is: FOLLOWER
I20260201 08:59:37.565582 20691 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [sys.catalog]: configured and running, proceeding with master startup.
I20260201 08:59:37.565960 20666 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:37.574653 20117 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2: NewTableName [id=f6b2fbdd3fad41339961f326c5cdddc7] alter complete (version 1)
I20260201 08:59:37.582616 20698 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0881025374f24934891bbdb80e59dbf2. Latest consensus state: current_term: 3 leader_uuid: "0881025374f24934891bbdb80e59dbf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:37.583163 20698 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [sys.catalog]: This master's current role is: FOLLOWER
I20260201 08:59:37.583739 20706 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "0881025374f24934891bbdb80e59dbf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:37.584380 20706 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [sys.catalog]: This master's current role is: FOLLOWER
I20260201 08:59:37.584859 20655 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "0881025374f24934891bbdb80e59dbf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:37.585588 20655 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [sys.catalog]: This master's current role is: LEADER
I20260201 08:59:37.603631 20713 catalog_manager.cc:1269] Loaded cluster ID: 56278e18ac6043958bcc9e9de47661ab
I20260201 08:59:37.603852 20713 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689: loading cluster ID for follower catalog manager: success
I20260201 08:59:37.610420 20713 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689: acquiring CA information for follower catalog manager: success
I20260201 08:59:37.614636 20713 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260201 08:59:37.636653 20656 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" instance_seqno: 1769936373958594) as {username='slave'} at 127.0.0.1:41002; Asking this server to re-register.
I20260201 08:59:37.637899 20503 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:37.640437 20656 ts_manager.cc:194] Registered new tserver with Master: 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 08:59:37.663520 20656 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" instance_seqno: 1769936373655794) as {username='slave'} at 127.0.0.1:41028; Asking this server to re-register.
I20260201 08:59:37.664935 20347 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:37.665278 20654 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" instance_seqno: 1769936373811681) as {username='slave'} at 127.0.0.1:41012; Asking this server to re-register.
I20260201 08:59:37.666464 20425 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:37.667900 20654 ts_manager.cc:194] Registered new tserver with Master: d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191)
I20260201 08:59:37.669495 20656 ts_manager.cc:194] Registered new tserver with Master: 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 08:59:37.669818 18612 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.198076652s
I20260201 08:59:37.677938 18612 master.cc:561] Master@127.18.45.61:37187 shutting down...
I20260201 08:59:37.710095 18612 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 3 LEADER]: Raft consensus shutting down.
I20260201 08:59:37.710877 18612 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:37.711347 18612 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2: stopping tablet replica
I20260201 08:59:37.735368 18612 master.cc:583] Master@127.18.45.61:37187 shutdown complete.
I20260201 08:59:37.887871 20622 raft_consensus.cc:493] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0881025374f24934891bbdb80e59dbf2)
I20260201 08:59:37.888415 20622 raft_consensus.cc:515] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:37.890055 20622 leader_election.cc:290] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c8e1752930448a8877eff36fdda0689 (127.18.45.62:34393), 0881025374f24934891bbdb80e59dbf2 (127.18.45.61:37187)
I20260201 08:59:37.892483 20706 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0881025374f24934891bbdb80e59dbf2)
I20260201 08:59:37.892925 20706 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:37.895442 20706 leader_election.cc:290] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0881025374f24934891bbdb80e59dbf2 (127.18.45.61:37187), cdf47e38da57474fa9a1f6f8698dd6ec (127.18.45.60:41717)
W20260201 08:59:37.899932 20171 leader_election.cc:336] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0881025374f24934891bbdb80e59dbf2 (127.18.45.61:37187): Network error: Client connection negotiation failed: client connection to 127.18.45.61:37187: connect: Connection refused (error 111)
I20260201 08:59:37.902172 20666 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 19 } } ignore_live_leader: false dest_uuid: "0c8e1752930448a8877eff36fdda0689" is_pre_election: true
I20260201 08:59:37.902844 20666 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdf47e38da57474fa9a1f6f8698dd6ec in term 3.
I20260201 08:59:37.904203 20169 leader_election.cc:304] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8e1752930448a8877eff36fdda0689, cdf47e38da57474fa9a1f6f8698dd6ec; no voters: 0881025374f24934891bbdb80e59dbf2
I20260201 08:59:37.904965 20622 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:37.905329 20622 raft_consensus.cc:493] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0881025374f24934891bbdb80e59dbf2)
I20260201 08:59:37.905691 20622 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:37.912705 20622 raft_consensus.cc:515] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:37.916610 20666 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 19 } } ignore_live_leader: false dest_uuid: "0c8e1752930448a8877eff36fdda0689"
I20260201 08:59:37.917171 20666 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:37.917881 20622 leader_election.cc:290] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [CANDIDATE]: Term 4 election: Requested vote from peers 0c8e1752930448a8877eff36fdda0689 (127.18.45.62:34393), 0881025374f24934891bbdb80e59dbf2 (127.18.45.61:37187)
W20260201 08:59:37.918479 20171 leader_election.cc:336] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0881025374f24934891bbdb80e59dbf2 (127.18.45.61:37187): Network error: Client connection negotiation failed: client connection to 127.18.45.61:37187: connect: Connection refused (error 111)
I20260201 08:59:37.921659 20666 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf47e38da57474fa9a1f6f8698dd6ec in term 4.
I20260201 08:59:37.922506 20169 leader_election.cc:304] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8e1752930448a8877eff36fdda0689, cdf47e38da57474fa9a1f6f8698dd6ec; no voters: 0881025374f24934891bbdb80e59dbf2
I20260201 08:59:37.923120 20622 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:59:37.924366 20622 raft_consensus.cc:697] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 4 LEADER]: Becoming Leader. State: Replica: cdf47e38da57474fa9a1f6f8698dd6ec, State: Running, Role: LEADER
I20260201 08:59:37.925161 20622 consensus_queue.cc:237] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 3.19, Last appended by leader: 19, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
W20260201 08:59:37.926204 20642 leader_election.cc:336] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0881025374f24934891bbdb80e59dbf2 (127.18.45.61:37187): Network error: Client connection negotiation failed: client connection to 127.18.45.61:37187: connect: Connection refused (error 111)
I20260201 08:59:37.926486 20194 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c8e1752930448a8877eff36fdda0689" candidate_term: 4 candidate_status { last_received { term: 3 index: 19 } } ignore_live_leader: false dest_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" is_pre_election: true
I20260201 08:59:37.927523 20642 leader_election.cc:304] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c8e1752930448a8877eff36fdda0689; no voters: 0881025374f24934891bbdb80e59dbf2, cdf47e38da57474fa9a1f6f8698dd6ec
I20260201 08:59:37.928164 20706 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:37.928557 20722 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdf47e38da57474fa9a1f6f8698dd6ec. Latest consensus state: current_term: 4 leader_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:37.929127 20722 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [sys.catalog]: This master's current role is: LEADER
I20260201 08:59:37.930361 20723 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 08:59:37.934235 20723 catalog_manager.cc:679] Loaded metadata for table NewTableName [id=f6b2fbdd3fad41339961f326c5cdddc7]
I20260201 08:59:37.937855 20723 tablet_loader.cc:96] loaded metadata for tablet 5e484bc43fd043a9b9c1311a444a4523 (table NewTableName [id=f6b2fbdd3fad41339961f326c5cdddc7])
I20260201 08:59:37.938737 20723 tablet_loader.cc:96] loaded metadata for tablet a4213e9edfbb4340b1674cb7549ff0e8 (table NewTableName [id=f6b2fbdd3fad41339961f326c5cdddc7])
I20260201 08:59:37.939603 20723 tablet_loader.cc:96] loaded metadata for tablet d541aece5fc7448188615547b8e48598 (table NewTableName [id=f6b2fbdd3fad41339961f326c5cdddc7])
I20260201 08:59:37.940610 20723 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 08:59:37.943374 20723 catalog_manager.cc:1269] Loaded cluster ID: 56278e18ac6043958bcc9e9de47661ab
I20260201 08:59:37.943544 20723 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 08:59:37.946830 20723 catalog_manager.cc:1514] Loading token signing keys...
I20260201 08:59:37.948166 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260201 08:59:37.950760 20723 catalog_manager.cc:6038] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec: Loaded TSK: 0
I20260201 08:59:37.951562 20723 catalog_manager.cc:1524] Initializing in-progress tserver states...
W20260201 08:59:37.954237 20724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:37.955590 20725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:37.957695 20727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:37.958451 18612 server_base.cc:1060] running on GCE node
I20260201 08:59:37.959201 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:37.959425 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:37.959609 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936377959591 us; error 0 us; skew 500 ppm
I20260201 08:59:37.960070 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:37.962149 18612 webserver.cc:492] Webserver started at http://127.18.45.61:44557/ using document root <none> and password file <none>
I20260201 08:59:37.962603 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:37.962782 18612 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260201 08:59:37.965678 18612 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260201 08:59:37.968086 20732 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:37.968781 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260201 08:59:37.969111 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/master-1-root
uuid: "0881025374f24934891bbdb80e59dbf2"
format_stamp: "Formatted at 2026-02-01 08:59:33 on dist-test-slave-zz6f"
I20260201 08:59:37.969395 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:37.991401 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:37.992341 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260201 08:59:38.022845 20171 consensus_peers.cc:597] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec -> Peer 0881025374f24934891bbdb80e59dbf2 (127.18.45.61:37187): Couldn't send request to peer 0881025374f24934891bbdb80e59dbf2. Status: Network error: Client connection negotiation failed: client connection to 127.18.45.61:37187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:38.040290 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.61:37187
I20260201 08:59:38.040439 20783 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.61:37187 every 8 connection(s)
I20260201 08:59:38.047276 20666 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 4 FOLLOWER]: Refusing update from remote peer cdf47e38da57474fa9a1f6f8698dd6ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 19. Preceding OpId from leader: term: 4 index: 20. (index mismatch)
I20260201 08:59:38.047863 20784 sys_catalog.cc:263] Verifying existing consensus state
I20260201 08:59:38.048390 20722 consensus_queue.cc:1048] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260201 08:59:38.051218 20706 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdf47e38da57474fa9a1f6f8698dd6ec. Latest consensus state: current_term: 4 leader_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:38.051859 20706 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [sys.catalog]: This master's current role is: FOLLOWER
I20260201 08:59:38.053370 20784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2: Bootstrap starting.
I20260201 08:59:38.053980 20622 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:38.054637 20622 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [sys.catalog]: This master's current role is: LEADER
I20260201 08:59:38.054718 20706 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:38.055470 20706 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [sys.catalog]: This master's current role is: FOLLOWER
I20260201 08:59:38.088480 20423 heartbeater.cc:499] Master 127.18.45.60:41717 was elected leader, sending a full tablet report...
I20260201 08:59:38.100499 20501 heartbeater.cc:499] Master 127.18.45.60:41717 was elected leader, sending a full tablet report...
I20260201 08:59:38.105846 20424 heartbeater.cc:344] Connected to a master server at 127.18.45.61:37187
I20260201 08:59:38.106271 20345 heartbeater.cc:499] Master 127.18.45.60:41717 was elected leader, sending a full tablet report...
I20260201 08:59:38.124730 20784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2: Bootstrap replayed 1/1 log segments. Stats: ops{read=19 overwritten=0 applied=19 ignored=0} inserts{seen=7 ignored=0} mutations{seen=15 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:38.125928 20784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2: Bootstrap complete.
I20260201 08:59:38.126446 20502 heartbeater.cc:344] Connected to a master server at 127.18.45.61:37187
I20260201 08:59:38.129194 20784 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:38.130054 20784 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0881025374f24934891bbdb80e59dbf2, State: Initialized, Role: FOLLOWER
I20260201 08:59:38.129753 20346 heartbeater.cc:344] Connected to a master server at 127.18.45.61:37187
I20260201 08:59:38.130728 20784 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 19, Last appended: 3.19, Last appended by leader: 19, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 08:59:38.136260 20784 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [sys.catalog]: configured and running, proceeding with master startup.
I20260201 08:59:38.135663 20791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:38.138235 20791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [sys.catalog]: This master's current role is: FOLLOWER
I20260201 08:59:38.144102 20759 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:38.155069 20791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdf47e38da57474fa9a1f6f8698dd6ec. Latest consensus state: current_term: 4 leader_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:38.155756 20791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [sys.catalog]: This master's current role is: FOLLOWER
I20260201 08:59:38.156086 20804 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:38.156836 20804 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [sys.catalog]: This master's current role is: FOLLOWER
I20260201 08:59:38.160583 20805 catalog_manager.cc:1269] Loaded cluster ID: 56278e18ac6043958bcc9e9de47661ab
I20260201 08:59:38.160815 20805 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2: loading cluster ID for follower catalog manager: success
I20260201 08:59:38.165930 20805 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2: acquiring CA information for follower catalog manager: success
I20260201 08:59:38.169275 20805 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260201 08:59:38.211220 20749 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" instance_seqno: 1769936373811681) as {username='slave'} at 127.0.0.1:38648; Asking this server to re-register.
I20260201 08:59:38.212399 20424 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:38.215204 20749 ts_manager.cc:194] Registered new tserver with Master: 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 08:59:38.219626 20786 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } } }
I20260201 08:59:38.220194 20786 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [sys.catalog]: This master's current role is: LEADER
I20260201 08:59:38.240255 20749 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" instance_seqno: 1769936373958594) as {username='slave'} at 127.0.0.1:38654; Asking this server to re-register.
I20260201 08:59:38.243713 20502 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:38.244890 20749 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" instance_seqno: 1769936373655794) as {username='slave'} at 127.0.0.1:38656; Asking this server to re-register.
I20260201 08:59:38.246168 20346 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:38.246699 20748 ts_manager.cc:194] Registered new tserver with Master: 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 08:59:38.248350 20748 ts_manager.cc:194] Registered new tserver with Master: d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191)
I20260201 08:59:38.249150 18612 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.206162893s
I20260201 09:00:05.529969 20829 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cdf47e38da57474fa9a1f6f8698dd6ec)
I20260201 09:00:05.530894 20829 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 09:00:05.534353 20829 leader_election.cc:290] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c8e1752930448a8877eff36fdda0689 (127.18.45.62:34393), cdf47e38da57474fa9a1f6f8698dd6ec (127.18.45.60:41717)
I20260201 09:00:05.535682 20831 raft_consensus.cc:493] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d9e4e07649b441e9b1e9e5da9361cec3)
I20260201 09:00:05.536074 20831 raft_consensus.cc:515] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 09:00:05.538906 20831 leader_election.cc:290] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 09:00:05.592742 20834 raft_consensus.cc:493] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d9e4e07649b441e9b1e9e5da9361cec3)
I20260201 09:00:05.593317 20834 raft_consensus.cc:515] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 09:00:05.600221 20834 leader_election.cc:290] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 09:00:05.600755 20834 raft_consensus.cc:493] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d9e4e07649b441e9b1e9e5da9361cec3)
I20260201 09:00:05.601810 20834 raft_consensus.cc:515] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 09:00:05.602587 20397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5" is_pre_election: true
I20260201 09:00:05.603348 20397 raft_consensus.cc:2468] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in term 6.
I20260201 09:00:05.604120 20834 leader_election.cc:290] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 09:00:05.605365 20441 leader_election.cc:304] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1, 9b54beaf2b694237916e31bea8d1a6a5; no voters:
I20260201 09:00:05.606148 20831 raft_consensus.cc:2804] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260201 09:00:05.606624 20831 raft_consensus.cc:493] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d9e4e07649b441e9b1e9e5da9361cec3)
I20260201 09:00:05.607105 20831 raft_consensus.cc:3060] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:05.608395 20836 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cdf47e38da57474fa9a1f6f8698dd6ec)
I20260201 09:00:05.608537 20320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" is_pre_election: true
I20260201 09:00:05.608898 20836 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8e1752930448a8877eff36fdda0689" member_type: VOTER last_known_addr { host: "127.18.45.62" port: 34393 } } peers { permanent_uuid: "0881025374f24934891bbdb80e59dbf2" member_type: VOTER last_known_addr { host: "127.18.45.61" port: 37187 } } peers { permanent_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" member_type: VOTER last_known_addr { host: "127.18.45.60" port: 41717 } }
I20260201 09:00:05.610096 20319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" is_pre_election: true
I20260201 09:00:05.611238 20834 raft_consensus.cc:493] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d9e4e07649b441e9b1e9e5da9361cec3)
I20260201 09:00:05.611766 20836 leader_election.cc:290] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0881025374f24934891bbdb80e59dbf2 (127.18.45.61:37187), cdf47e38da57474fa9a1f6f8698dd6ec (127.18.45.60:41717)
I20260201 09:00:05.611789 20834 raft_consensus.cc:515] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 09:00:05.614666 20834 leader_election.cc:290] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 09:00:05.615365 20319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" is_pre_election: true
I20260201 09:00:05.617944 20831 raft_consensus.cc:515] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 09:00:05.619439 20831 leader_election.cc:290] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 7 election: Requested vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 09:00:05.620062 20831 raft_consensus.cc:493] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d9e4e07649b441e9b1e9e5da9361cec3)
I20260201 09:00:05.620373 20397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5"
I20260201 09:00:05.621084 20397 raft_consensus.cc:3060] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:05.620522 20831 raft_consensus.cc:515] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 09:00:05.623438 20831 leader_election.cc:290] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 09:00:05.624159 20398 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5" is_pre_election: true
I20260201 09:00:05.624476 20398 raft_consensus.cc:2468] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in term 3.
I20260201 09:00:05.625085 20441 leader_election.cc:304] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1, 9b54beaf2b694237916e31bea8d1a6a5; no voters:
I20260201 09:00:05.625268 20475 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" is_pre_election: true
I20260201 09:00:05.625469 20319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" is_pre_election: true
I20260201 09:00:05.625785 20475 raft_consensus.cc:2468] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b54beaf2b694237916e31bea8d1a6a5 in term 3.
I20260201 09:00:05.626154 20320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3"
I20260201 09:00:05.626196 20318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" is_pre_election: true
I20260201 09:00:05.626900 20474 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" is_pre_election: true
I20260201 09:00:05.626966 20362 leader_election.cc:304] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1, 9b54beaf2b694237916e31bea8d1a6a5; no voters: d9e4e07649b441e9b1e9e5da9361cec3
I20260201 09:00:05.627590 20474 raft_consensus.cc:2468] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b54beaf2b694237916e31bea8d1a6a5 in term 2.
I20260201 09:00:05.627869 20834 raft_consensus.cc:2804] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 09:00:05.628259 20834 raft_consensus.cc:493] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d9e4e07649b441e9b1e9e5da9361cec3)
I20260201 09:00:05.628667 20834 raft_consensus.cc:3060] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:05.628541 20362 leader_election.cc:304] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1, 9b54beaf2b694237916e31bea8d1a6a5; no voters: d9e4e07649b441e9b1e9e5da9361cec3
I20260201 09:00:05.629189 20397 raft_consensus.cc:2468] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in term 7.
I20260201 09:00:05.630103 20835 raft_consensus.cc:2804] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 09:00:05.630125 20441 leader_election.cc:304] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1, 9b54beaf2b694237916e31bea8d1a6a5; no voters:
I20260201 09:00:05.630703 20835 raft_consensus.cc:493] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d9e4e07649b441e9b1e9e5da9361cec3)
I20260201 09:00:05.631119 20835 raft_consensus.cc:3060] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 2 FOLLOWER]: Advancing to term 3
I20260201 09:00:05.631217 20837 raft_consensus.cc:2804] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 09:00:05.631657 20837 raft_consensus.cc:493] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d9e4e07649b441e9b1e9e5da9361cec3)
I20260201 09:00:05.631788 20831 raft_consensus.cc:2804] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 7 FOLLOWER]: Leader election won for term 7
I20260201 09:00:05.632115 20837 raft_consensus.cc:3060] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:05.641825 20837 raft_consensus.cc:515] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 09:00:05.642210 20834 raft_consensus.cc:515] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 09:00:05.644310 20834 leader_election.cc:290] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 4 election: Requested vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 09:00:05.644642 20318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3"
I20260201 09:00:05.644766 20831 raft_consensus.cc:697] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 7 LEADER]: Becoming Leader. State: Replica: 1d8a0e7216f2425d848f56d2a1cef6b1, State: Running, Role: LEADER
I20260201 09:00:05.645936 20831 consensus_queue.cc:237] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 09:00:05.646693 20318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3"
I20260201 09:00:05.650755 20837 leader_election.cc:290] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 4 election: Requested vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 09:00:05.653971 20398 raft_consensus.cc:1240] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 4 FOLLOWER]: Rejecting Update request from peer d9e4e07649b441e9b1e9e5da9361cec3 for earlier term 3. Current term is 4. Ops: []
I20260201 09:00:05.654271 20397 raft_consensus.cc:1240] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 7 FOLLOWER]: Rejecting Update request from peer d9e4e07649b441e9b1e9e5da9361cec3 for earlier term 6. Current term is 7. Ops: []
I20260201 09:00:05.654982 20396 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5"
I20260201 09:00:05.655743 20396 raft_consensus.cc:2393] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in current term 4: Already voted for candidate 9b54beaf2b694237916e31bea8d1a6a5 in this term.
I20260201 09:00:05.657225 20441 leader_election.cc:304] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1; no voters: 9b54beaf2b694237916e31bea8d1a6a5, d9e4e07649b441e9b1e9e5da9361cec3
I20260201 09:00:05.657555 20830 consensus_queue.cc:1059] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260201 09:00:05.658514 20830 raft_consensus.cc:3055] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 3 LEADER]: Stepping down as leader of term 3
I20260201 09:00:05.658396 20833 consensus_queue.cc:1059] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260201 09:00:05.658841 20830 raft_consensus.cc:740] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d9e4e07649b441e9b1e9e5da9361cec3, State: Running, Role: LEADER
I20260201 09:00:05.659314 20833 raft_consensus.cc:3055] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 6 LEADER]: Stepping down as leader of term 6
I20260201 09:00:05.659654 20833 raft_consensus.cc:740] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d9e4e07649b441e9b1e9e5da9361cec3, State: Running, Role: LEADER
I20260201 09:00:05.659582 20830 consensus_queue.cc:260] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 09:00:05.660463 20833 consensus_queue.cc:260] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 09:00:05.660878 20830 raft_consensus.cc:3060] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:05.661639 20833 raft_consensus.cc:3060] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:05.661893 20474 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1"
I20260201 09:00:05.663578 20474 raft_consensus.cc:2393] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b54beaf2b694237916e31bea8d1a6a5 in current term 4: Already voted for candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in this term.
I20260201 09:00:05.665271 20362 leader_election.cc:304] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b54beaf2b694237916e31bea8d1a6a5; no voters: 1d8a0e7216f2425d848f56d2a1cef6b1, d9e4e07649b441e9b1e9e5da9361cec3
I20260201 09:00:05.665606 20837 raft_consensus.cc:2749] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 09:00:05.666326 20834 raft_consensus.cc:2749] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 09:00:05.671468 20473 raft_consensus.cc:1240] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: Rejecting Update request from peer d9e4e07649b441e9b1e9e5da9361cec3 for earlier term 3. Current term is 4. Ops: []
I20260201 09:00:05.678917 20835 raft_consensus.cc:515] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
W20260201 09:00:05.680420 20271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:05.683740 20396 raft_consensus.cc:1240] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 3 FOLLOWER]: Rejecting Update request from peer d9e4e07649b441e9b1e9e5da9361cec3 for earlier term 2. Current term is 3. Ops: []
I20260201 09:00:05.686533 20475 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1"
I20260201 09:00:05.687044 20318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3"
I20260201 09:00:05.688700 20361 leader_election.cc:304] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b54beaf2b694237916e31bea8d1a6a5; no voters: 1d8a0e7216f2425d848f56d2a1cef6b1, d9e4e07649b441e9b1e9e5da9361cec3
I20260201 09:00:05.689618 20834 raft_consensus.cc:2749] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 09:00:05.691612 20835 leader_election.cc:290] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 3 election: Requested vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
W20260201 09:00:05.694748 20171 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.45.61:37187, user_credentials={real_user=slave}} blocked reactor thread for 51822.3us
I20260201 09:00:05.695959 20474 raft_consensus.cc:1240] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 7 LEADER]: Rejecting Update request from peer d9e4e07649b441e9b1e9e5da9361cec3 for earlier term 6. Current term is 7. Ops: []
I20260201 09:00:05.698210 20476 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4213e9edfbb4340b1674cb7549ff0e8" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" is_pre_election: true
I20260201 09:00:05.699366 20362 leader_election.cc:304] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b54beaf2b694237916e31bea8d1a6a5; no voters: 1d8a0e7216f2425d848f56d2a1cef6b1, d9e4e07649b441e9b1e9e5da9361cec3
I20260201 09:00:05.700806 20835 raft_consensus.cc:2749] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260201 09:00:05.705803 20274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:05.708317 20828 consensus_queue.cc:1059] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260201 09:00:05.709195 20828 raft_consensus.cc:3055] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 09:00:05.709403 20828 raft_consensus.cc:740] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d9e4e07649b441e9b1e9e5da9361cec3, State: Running, Role: LEADER
I20260201 09:00:05.710054 20828 consensus_queue.cc:260] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 09:00:05.711036 20828 raft_consensus.cc:3060] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 2 FOLLOWER]: Advancing to term 3
I20260201 09:00:05.717803 20194 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0881025374f24934891bbdb80e59dbf2" candidate_term: 5 candidate_status { last_received { term: 4 index: 20 } } ignore_live_leader: false dest_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" is_pre_election: true
I20260201 09:00:05.721735 20194 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c8e1752930448a8877eff36fdda0689" candidate_term: 5 candidate_status { last_received { term: 4 index: 20 } } ignore_live_leader: false dest_uuid: "cdf47e38da57474fa9a1f6f8698dd6ec" is_pre_election: true
I20260201 09:00:05.725081 20184 catalog_manager.cc:5654] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 reported cstate change: term changed from 6 to 7, leader changed from d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1) to 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3). New cstate: current_term: 7 leader_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } health_report { overall_health: HEALTHY } } }
I20260201 09:00:05.726219 20759 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c8e1752930448a8877eff36fdda0689" candidate_term: 5 candidate_status { last_received { term: 4 index: 20 } } ignore_live_leader: false dest_uuid: "0881025374f24934891bbdb80e59dbf2" is_pre_election: true
I20260201 09:00:05.727738 20642 leader_election.cc:304] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c8e1752930448a8877eff36fdda0689; no voters: 0881025374f24934891bbdb80e59dbf2, cdf47e38da57474fa9a1f6f8698dd6ec
I20260201 09:00:05.729420 20836 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:05.733582 20666 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0881025374f24934891bbdb80e59dbf2" candidate_term: 5 candidate_status { last_received { term: 4 index: 20 } } ignore_live_leader: false dest_uuid: "0c8e1752930448a8877eff36fdda0689" is_pre_election: true
I20260201 09:00:05.735008 20735 leader_election.cc:304] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0881025374f24934891bbdb80e59dbf2; no voters: 0c8e1752930448a8877eff36fdda0689, cdf47e38da57474fa9a1f6f8698dd6ec
I20260201 09:00:05.739327 20829 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:05.767196 20318 raft_consensus.cc:1275] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 7 FOLLOWER]: Refusing update from remote peer 1d8a0e7216f2425d848f56d2a1cef6b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260201 09:00:05.767227 20396 raft_consensus.cc:1275] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 7 FOLLOWER]: Refusing update from remote peer 1d8a0e7216f2425d848f56d2a1cef6b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260201 09:00:05.768508 20831 consensus_queue.cc:1048] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260201 09:00:05.769057 20837 consensus_queue.cc:1048] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260201 09:00:05.859481 20828 raft_consensus.cc:493] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:05.859795 20828 raft_consensus.cc:515] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 09:00:05.861549 20828 leader_election.cc:290] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 09:00:05.862082 20396 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5" is_pre_election: true
I20260201 09:00:05.862293 20474 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" is_pre_election: true
I20260201 09:00:05.862555 20396 raft_consensus.cc:2468] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9e4e07649b441e9b1e9e5da9361cec3 in term 4.
I20260201 09:00:05.862758 20474 raft_consensus.cc:2468] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9e4e07649b441e9b1e9e5da9361cec3 in term 4.
I20260201 09:00:05.863389 20273 leader_election.cc:304] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b54beaf2b694237916e31bea8d1a6a5, d9e4e07649b441e9b1e9e5da9361cec3; no voters:
I20260201 09:00:05.863893 20828 raft_consensus.cc:2804] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 09:00:05.864161 20828 raft_consensus.cc:493] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:05.864467 20828 raft_consensus.cc:3060] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:05.868979 20828 raft_consensus.cc:515] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 09:00:05.870236 20828 leader_election.cc:290] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 5 election: Requested vote from peers 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 09:00:05.871058 20474 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1"
I20260201 09:00:05.870995 20396 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e484bc43fd043a9b9c1311a444a4523" candidate_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5"
I20260201 09:00:05.871620 20474 raft_consensus.cc:3060] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:05.871819 20396 raft_consensus.cc:3060] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:05.875190 20831 raft_consensus.cc:493] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d9e4e07649b441e9b1e9e5da9361cec3)
I20260201 09:00:05.875602 20474 raft_consensus.cc:2468] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9e4e07649b441e9b1e9e5da9361cec3 in term 5.
I20260201 09:00:05.875690 20831 raft_consensus.cc:515] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 09:00:05.876551 20396 raft_consensus.cc:2468] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9e4e07649b441e9b1e9e5da9361cec3 in term 5.
I20260201 09:00:05.876770 20272 leader_election.cc:304] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1, d9e4e07649b441e9b1e9e5da9361cec3; no voters:
I20260201 09:00:05.877426 20831 leader_election.cc:290] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 09:00:05.877444 20828 raft_consensus.cc:2804] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 5 FOLLOWER]: Leader election won for term 5
I20260201 09:00:05.878033 20318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" is_pre_election: true
I20260201 09:00:05.878091 20828 raft_consensus.cc:697] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 5 LEADER]: Becoming Leader. State: Replica: d9e4e07649b441e9b1e9e5da9361cec3, State: Running, Role: LEADER
I20260201 09:00:05.878731 20318 raft_consensus.cc:2468] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in term 3.
I20260201 09:00:05.878952 20828 consensus_queue.cc:237] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 09:00:05.879794 20439 leader_election.cc:304] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1, d9e4e07649b441e9b1e9e5da9361cec3; no voters:
I20260201 09:00:05.880110 20396 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5" is_pre_election: true
I20260201 09:00:05.880513 20831 raft_consensus.cc:2804] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 09:00:05.880962 20396 raft_consensus.cc:2393] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in current term 3: Already voted for candidate 9b54beaf2b694237916e31bea8d1a6a5 in this term.
I20260201 09:00:05.880867 20831 raft_consensus.cc:493] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d9e4e07649b441e9b1e9e5da9361cec3)
I20260201 09:00:05.881356 20831 raft_consensus.cc:3060] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260201 09:00:05.887581 20183 catalog_manager.cc:5654] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } health_report { overall_health: UNKNOWN } } }
I20260201 09:00:05.890481 20831 raft_consensus.cc:515] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 09:00:05.892378 20318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3"
I20260201 09:00:05.892527 20396 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9b54beaf2b694237916e31bea8d1a6a5"
I20260201 09:00:05.893179 20396 raft_consensus.cc:2393] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in current term 3: Already voted for candidate 9b54beaf2b694237916e31bea8d1a6a5 in this term.
I20260201 09:00:05.894233 20831 leader_election.cc:290] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 3 election: Requested vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
I20260201 09:00:05.900178 20318 raft_consensus.cc:2468] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d8a0e7216f2425d848f56d2a1cef6b1 in term 3.
I20260201 09:00:05.901258 20439 leader_election.cc:304] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1, d9e4e07649b441e9b1e9e5da9361cec3; no voters: 9b54beaf2b694237916e31bea8d1a6a5
I20260201 09:00:05.903036 20831 raft_consensus.cc:2804] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 3 FOLLOWER]: Leader election won for term 3
I20260201 09:00:05.903376 20831 raft_consensus.cc:697] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 3 LEADER]: Becoming Leader. State: Replica: 1d8a0e7216f2425d848f56d2a1cef6b1, State: Running, Role: LEADER
I20260201 09:00:05.904058 20831 consensus_queue.cc:237] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 09:00:05.913326 20183 catalog_manager.cc:5654] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 reported cstate change: term changed from 2 to 3, leader changed from d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1) to 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3). New cstate: current_term: 3 leader_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } health_report { overall_health: UNKNOWN } } }
I20260201 09:00:05.929867 20835 raft_consensus.cc:493] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:05.930238 20835 raft_consensus.cc:515] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 09:00:05.931599 20835 leader_election.cc:290] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 09:00:05.932087 20318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" is_pre_election: true
I20260201 09:00:05.932469 20474 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" is_pre_election: true
I20260201 09:00:05.932734 20318 raft_consensus.cc:2468] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b54beaf2b694237916e31bea8d1a6a5 in term 3.
I20260201 09:00:05.933583 20361 leader_election.cc:304] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b54beaf2b694237916e31bea8d1a6a5, d9e4e07649b441e9b1e9e5da9361cec3; no voters:
I20260201 09:00:05.934147 20835 raft_consensus.cc:2804] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 09:00:05.934482 20835 raft_consensus.cc:493] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:05.934718 20835 raft_consensus.cc:3060] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:05.938540 20835 raft_consensus.cc:515] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 09:00:05.939958 20835 leader_election.cc:290] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 4 election: Requested vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3:33747)
I20260201 09:00:05.940490 20318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d9e4e07649b441e9b1e9e5da9361cec3"
I20260201 09:00:05.940788 20474 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d541aece5fc7448188615547b8e48598" candidate_uuid: "9b54beaf2b694237916e31bea8d1a6a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1"
I20260201 09:00:05.940932 20318 raft_consensus.cc:3060] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:05.944386 20318 raft_consensus.cc:2468] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b54beaf2b694237916e31bea8d1a6a5 in term 4.
I20260201 09:00:05.945102 20361 leader_election.cc:304] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b54beaf2b694237916e31bea8d1a6a5, d9e4e07649b441e9b1e9e5da9361cec3; no voters: 1d8a0e7216f2425d848f56d2a1cef6b1
I20260201 09:00:05.945636 20835 raft_consensus.cc:2804] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260201 09:00:05.945996 20835 raft_consensus.cc:697] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 4 LEADER]: Becoming Leader. State: Replica: 9b54beaf2b694237916e31bea8d1a6a5, State: Running, Role: LEADER
I20260201 09:00:05.946834 20835 consensus_queue.cc:237] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 09:00:05.952641 20183 catalog_manager.cc:5654] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 reported cstate change: term changed from 3 to 4, leader changed from 1d8a0e7216f2425d848f56d2a1cef6b1 (127.18.45.3) to 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2). New cstate: current_term: 4 leader_uuid: "9b54beaf2b694237916e31bea8d1a6a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } health_report { overall_health: HEALTHY } } }
I20260201 09:00:05.995880 20396 raft_consensus.cc:1275] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 5 FOLLOWER]: Refusing update from remote peer d9e4e07649b441e9b1e9e5da9361cec3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260201 09:00:05.996671 20828 consensus_queue.cc:1048] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260201 09:00:05.998860 20474 raft_consensus.cc:1275] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 5 FOLLOWER]: Refusing update from remote peer d9e4e07649b441e9b1e9e5da9361cec3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260201 09:00:06.000077 20828 consensus_queue.cc:1048] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260201 09:00:06.020152 20318 raft_consensus.cc:1240] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 4 FOLLOWER]: Rejecting Update request from peer 1d8a0e7216f2425d848f56d2a1cef6b1 for earlier term 3. Current term is 4. Ops: []
I20260201 09:00:06.021436 20831 consensus_queue.cc:1059] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 09:00:06.022090 20831 raft_consensus.cc:3055] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 3 LEADER]: Stepping down as leader of term 3
I20260201 09:00:06.022362 20831 raft_consensus.cc:740] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1d8a0e7216f2425d848f56d2a1cef6b1, State: Running, Role: LEADER
I20260201 09:00:06.022940 20831 consensus_queue.cc:260] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 09:00:06.024181 20831 raft_consensus.cc:3060] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:06.034322 20474 raft_consensus.cc:1275] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: Refusing update from remote peer 9b54beaf2b694237916e31bea8d1a6a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260201 09:00:06.034621 20474 pending_rounds.cc:85] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1: Aborting all ops after (but not including) 4
I20260201 09:00:06.034881 20474 pending_rounds.cc:107] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260201 09:00:06.035085 20474 raft_consensus.cc:2889] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 09:00:06.036017 20835 consensus_queue.cc:1048] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 09:00:06.042344 20318 raft_consensus.cc:1275] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 4 FOLLOWER]: Refusing update from remote peer 9b54beaf2b694237916e31bea8d1a6a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260201 09:00:06.043593 20835 consensus_queue.cc:1048] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260201 09:00:06.562930 20419 debug-util.cc:398] Leaking SignalData structure 0x7b08001cf060 after lost signal to thread 18615
W20260201 09:00:06.576736 20419 debug-util.cc:398] Leaking SignalData structure 0x7b08000cce20 after lost signal to thread 20344
W20260201 09:00:06.578137 20419 debug-util.cc:398] Leaking SignalData structure 0x7b080008c9c0 after lost signal to thread 20422
W20260201 09:00:06.579506 20419 debug-util.cc:398] Leaking SignalData structure 0x7b08000659c0 after lost signal to thread 20500
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc:784: Failure
Expected equality of these values:
live_row_count
Which is: 802
table_info->GetMetrics()->live_row_count->value()
Which is: 0
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/test_util.cc:403: Failure
Failed
Timed out waiting for assertion to pass.
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc:768: Failure
Expected: check_function(table_infos[0].get(), live_row_count) doesn't generate new fatal failures in the current thread.
Actual: it does.
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc:786: Failure
Expected: GetLeaderMasterAndRun(live_row_count, [&] ( TableInfo* table_info, int64_t live_row_count) { do { AssertEventually([&] () { switch (0) case 0: default: if (const ::testing::AssertionResult gtest_ar_ = ::testing::AssertionResult(table_info->GetMetrics()->TableSupportsLiveRowCount())) ; else return ::testing::internal::AssertHelper(::testing::TestPartResult::kFatalFailure, "/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc", 783, ::testing::internal::GetBoolAssertionFailureMessage( gtest_ar_, "table_info->GetMetrics()->TableSupportsLiveRowCount()", "false", "true") .c_str()) = ::testing::Message(); switch (0) case 0: default: if (const ::testing::AssertionResult gtest_ar = (::testing::internal::EqHelper::Compare("live_row_count", "table_info->GetMetrics()->live_row_count->value()", live_row_count, table_info->GetMetrics()->live_row_count->value()))) ; else return ::testing::internal::AssertHelper(::testing::TestPartResult::kFatalFailure, "/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc", 784, gtest_ar.failure_message()) = ::testing::Message(); }); do { if (testing::Test::HasFatalFailure()) { return; } } while (0); } while (0); }) doesn't generate new fatal failures in the current thread.
Actual: it does.
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc:896: Failure
Expected: CheckStats(kRowsCount) doesn't generate new fatal failures in the current thread.
Actual: it does.
I20260201 09:00:08.389299 18612 tablet_server.cc:178] TabletServer@127.18.45.1:0 shutting down...
I20260201 09:00:08.423025 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 09:00:08.423769 18612 tablet_replica.cc:333] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3: stopping tablet replica
I20260201 09:00:08.424520 18612 raft_consensus.cc:2243] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 09:00:08.425140 18612 raft_consensus.cc:2272] T d541aece5fc7448188615547b8e48598 P d9e4e07649b441e9b1e9e5da9361cec3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:08.428231 18612 tablet_replica.cc:333] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3: stopping tablet replica
I20260201 09:00:08.428689 18612 raft_consensus.cc:2243] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 5 LEADER]: Raft consensus shutting down.
I20260201 09:00:08.429627 18612 raft_consensus.cc:2272] T 5e484bc43fd043a9b9c1311a444a4523 P d9e4e07649b441e9b1e9e5da9361cec3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:08.431891 18612 tablet_replica.cc:333] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3: stopping tablet replica
I20260201 09:00:08.432308 18612 raft_consensus.cc:2243] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260201 09:00:08.432677 18612 raft_consensus.cc:2272] T a4213e9edfbb4340b1674cb7549ff0e8 P d9e4e07649b441e9b1e9e5da9361cec3 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:08.447757 18612 tablet_server.cc:195] TabletServer@127.18.45.1:0 shutdown complete.
I20260201 09:00:08.467293 18612 tablet_server.cc:178] TabletServer@127.18.45.2:0 shutting down...
W20260201 09:00:08.478940 20439 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.45.1:39191: connect: Connection refused (error 111) [suppressed 13 similar messages]
W20260201 09:00:08.495613 20439 consensus_peers.cc:597] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 -> Peer d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191): Couldn't send request to peer d9e4e07649b441e9b1e9e5da9361cec3. Status: Network error: Client connection negotiation failed: client connection to 127.18.45.1:39191: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 09:00:08.513845 20361 consensus_peers.cc:597] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 -> Peer d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191): Couldn't send request to peer d9e4e07649b441e9b1e9e5da9361cec3. Status: Network error: Client connection negotiation failed: client connection to 127.18.45.1:39191: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 09:00:08.515821 20441 consensus_peers.cc:597] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 -> Peer 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763): Couldn't send request to peer 9b54beaf2b694237916e31bea8d1a6a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 09:00:08.528189 20831 raft_consensus.cc:493] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d9e4e07649b441e9b1e9e5da9361cec3)
I20260201 09:00:08.528658 20831 raft_consensus.cc:515] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 09:00:08.530110 20831 leader_election.cc:290] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
W20260201 09:00:08.533787 20441 leader_election.cc:336] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260201 09:00:08.538066 20439 leader_election.cc:336] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191): Network error: Client connection negotiation failed: client connection to 127.18.45.1:39191: connect: Connection refused (error 111)
I20260201 09:00:08.538581 20439 leader_election.cc:304] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1; no voters: 9b54beaf2b694237916e31bea8d1a6a5, d9e4e07649b441e9b1e9e5da9361cec3
I20260201 09:00:08.539347 20831 raft_consensus.cc:2749] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:08.539440 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 09:00:08.540480 18612 tablet_replica.cc:333] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5: stopping tablet replica
I20260201 09:00:08.542387 18612 raft_consensus.cc:2243] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260201 09:00:08.543049 18612 raft_consensus.cc:2272] T 5e484bc43fd043a9b9c1311a444a4523 P 9b54beaf2b694237916e31bea8d1a6a5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:08.545686 18612 tablet_replica.cc:333] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5: stopping tablet replica
I20260201 09:00:08.546118 18612 raft_consensus.cc:2243] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 4 LEADER]: Raft consensus shutting down.
I20260201 09:00:08.546764 18612 raft_consensus.cc:2272] T d541aece5fc7448188615547b8e48598 P 9b54beaf2b694237916e31bea8d1a6a5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:08.549520 18612 tablet_replica.cc:333] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5: stopping tablet replica
I20260201 09:00:08.549916 18612 raft_consensus.cc:2243] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260201 09:00:08.550442 18612 raft_consensus.cc:2272] T a4213e9edfbb4340b1674cb7549ff0e8 P 9b54beaf2b694237916e31bea8d1a6a5 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:08.744343 20876 raft_consensus.cc:493] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b54beaf2b694237916e31bea8d1a6a5)
I20260201 09:00:08.744999 20876 raft_consensus.cc:515] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 09:00:08.746932 20876 leader_election.cc:290] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
W20260201 09:00:08.750504 20439 leader_election.cc:336] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191): Network error: Client connection negotiation failed: client connection to 127.18.45.1:39191: connect: Connection refused (error 111)
W20260201 09:00:08.751313 20441 leader_election.cc:336] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763): Network error: Client connection negotiation failed: client connection to 127.18.45.2:33763: connect: Connection refused (error 111)
I20260201 09:00:08.751792 20441 leader_election.cc:304] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1; no voters: 9b54beaf2b694237916e31bea8d1a6a5, d9e4e07649b441e9b1e9e5da9361cec3
I20260201 09:00:08.752628 20876 raft_consensus.cc:2749] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:08.753681 20876 raft_consensus.cc:493] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d9e4e07649b441e9b1e9e5da9361cec3)
I20260201 09:00:08.754022 20876 raft_consensus.cc:515] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 09:00:08.755550 20876 leader_election.cc:290] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
W20260201 09:00:08.758984 20439 leader_election.cc:336] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191): Network error: Client connection negotiation failed: client connection to 127.18.45.1:39191: connect: Connection refused (error 111)
W20260201 09:00:08.760093 20441 leader_election.cc:336] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763): Network error: Client connection negotiation failed: client connection to 127.18.45.2:33763: connect: Connection refused (error 111)
I20260201 09:00:08.760520 20441 leader_election.cc:304] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1; no voters: 9b54beaf2b694237916e31bea8d1a6a5, d9e4e07649b441e9b1e9e5da9361cec3
I20260201 09:00:08.761209 20876 raft_consensus.cc:2749] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260201 09:00:08.979653 20439 consensus_peers.cc:597] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 -> Peer d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191): Couldn't send request to peer d9e4e07649b441e9b1e9e5da9361cec3. Status: Network error: Client connection negotiation failed: client connection to 127.18.45.1:39191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260201 09:00:09.005373 20876 raft_consensus.cc:493] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b54beaf2b694237916e31bea8d1a6a5)
I20260201 09:00:09.005774 20876 raft_consensus.cc:515] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 09:00:09.007187 20876 leader_election.cc:290] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
W20260201 09:00:09.010641 20439 leader_election.cc:336] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191): Network error: Client connection negotiation failed: client connection to 127.18.45.1:39191: connect: Connection refused (error 111)
W20260201 09:00:09.011298 20441 leader_election.cc:336] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763): Network error: Client connection negotiation failed: client connection to 127.18.45.2:33763: connect: Connection refused (error 111)
I20260201 09:00:09.011718 20441 leader_election.cc:304] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1; no voters: 9b54beaf2b694237916e31bea8d1a6a5, d9e4e07649b441e9b1e9e5da9361cec3
I20260201 09:00:09.012218 20876 raft_consensus.cc:2749] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260201 09:00:09.013540 20441 consensus_peers.cc:597] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 -> Peer 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763): Couldn't send request to peer 9b54beaf2b694237916e31bea8d1a6a5. Status: Network error: Client connection negotiation failed: client connection to 127.18.45.2:33763: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260201 09:00:09.060317 20876 raft_consensus.cc:493] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d9e4e07649b441e9b1e9e5da9361cec3)
I20260201 09:00:09.060657 20876 raft_consensus.cc:515] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } }
I20260201 09:00:09.061900 20876 leader_election.cc:290] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
W20260201 09:00:09.064739 20439 leader_election.cc:336] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191): Network error: Client connection negotiation failed: client connection to 127.18.45.1:39191: connect: Connection refused (error 111)
W20260201 09:00:09.065201 20441 leader_election.cc:336] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763): Network error: Client connection negotiation failed: client connection to 127.18.45.2:33763: connect: Connection refused (error 111)
I20260201 09:00:09.065599 20441 leader_election.cc:304] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1; no voters: 9b54beaf2b694237916e31bea8d1a6a5, d9e4e07649b441e9b1e9e5da9361cec3
I20260201 09:00:09.066229 20877 raft_consensus.cc:2749] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:09.387527 18612 tablet_server.cc:195] TabletServer@127.18.45.2:0 shutdown complete.
I20260201 09:00:09.400092 18612 tablet_server.cc:178] TabletServer@127.18.45.3:0 shutting down...
I20260201 09:00:09.424288 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 09:00:09.424618 20877 raft_consensus.cc:493] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b54beaf2b694237916e31bea8d1a6a5)
I20260201 09:00:09.424961 18612 tablet_replica.cc:333] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1: stopping tablet replica
I20260201 09:00:09.425130 20877 raft_consensus.cc:515] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e4e07649b441e9b1e9e5da9361cec3" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 39191 } } peers { permanent_uuid: "1d8a0e7216f2425d848f56d2a1cef6b1" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 33747 } } peers { permanent_uuid: "9b54beaf2b694237916e31bea8d1a6a5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 33763 } }
I20260201 09:00:09.425976 18612 raft_consensus.cc:2243] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 09:00:09.426599 18612 raft_consensus.cc:2272] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:09.427028 20877 leader_election.cc:290] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191), 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763)
W20260201 09:00:09.429896 20439 leader_election.cc:336] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d9e4e07649b441e9b1e9e5da9361cec3 (127.18.45.1:39191): Network error: Client connection negotiation failed: client connection to 127.18.45.1:39191: connect: Connection refused (error 111)
I20260201 09:00:09.430341 18612 tablet_replica.cc:333] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1: stopping tablet replica
W20260201 09:00:09.430531 20441 leader_election.cc:336] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b54beaf2b694237916e31bea8d1a6a5 (127.18.45.2:33763): Network error: Client connection negotiation failed: client connection to 127.18.45.2:33763: connect: Connection refused (error 111)
I20260201 09:00:09.430900 20441 leader_election.cc:304] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d8a0e7216f2425d848f56d2a1cef6b1; no voters: 9b54beaf2b694237916e31bea8d1a6a5, d9e4e07649b441e9b1e9e5da9361cec3
I20260201 09:00:09.431015 18612 raft_consensus.cc:2243] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 7 LEADER]: Raft consensus shutting down.
W20260201 09:00:09.431401 20441 raft_consensus.cc:2686] T d541aece5fc7448188615547b8e48598 P 1d8a0e7216f2425d848f56d2a1cef6b1: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260201 09:00:09.431852 18612 raft_consensus.cc:2272] T a4213e9edfbb4340b1674cb7549ff0e8 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:09.433976 18612 tablet_replica.cc:333] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1: stopping tablet replica
I20260201 09:00:09.434331 18612 raft_consensus.cc:2243] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260201 09:00:09.434643 18612 raft_consensus.cc:2272] T 5e484bc43fd043a9b9c1311a444a4523 P 1d8a0e7216f2425d848f56d2a1cef6b1 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:09.456593 18612 tablet_server.cc:195] TabletServer@127.18.45.3:0 shutdown complete.
I20260201 09:00:09.469864 18612 master.cc:561] Master@127.18.45.62:34393 shutting down...
I20260201 09:00:09.490399 18612 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 09:00:09.490837 18612 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0c8e1752930448a8877eff36fdda0689 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:09.491111 18612 tablet_replica.cc:333] stopping tablet replica
I20260201 09:00:09.508062 18612 master.cc:583] Master@127.18.45.62:34393 shutdown complete.
I20260201 09:00:09.520081 18612 master.cc:561] Master@127.18.45.61:37187 shutting down...
I20260201 09:00:09.538084 18612 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 09:00:09.538641 18612 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0881025374f24934891bbdb80e59dbf2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:09.538916 18612 tablet_replica.cc:333] stopping tablet replica
W20260201 09:00:09.543083 20169 consensus_peers.cc:597] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec -> Peer 0c8e1752930448a8877eff36fdda0689 (127.18.45.62:34393): Couldn't send request to peer 0c8e1752930448a8877eff36fdda0689. Status: Network error: Client connection negotiation failed: client connection to 127.18.45.62:34393: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 09:00:09.556545 18612 master.cc:583] Master@127.18.45.61:37187 shutdown complete.
I20260201 09:00:09.570977 18612 master.cc:561] Master@127.18.45.60:41717 shutting down...
I20260201 09:00:09.587188 18612 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 4 LEADER]: Raft consensus shutting down.
I20260201 09:00:09.587872 18612 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:09.588102 18612 tablet_replica.cc:333] T 00000000000000000000000000000000 P cdf47e38da57474fa9a1f6f8698dd6ec: stopping tablet replica
I20260201 09:00:09.606957 18612 master.cc:583] Master@127.18.45.60:41717 shutdown complete.
I20260201 09:00:09.628944 18612 test_util.cc:183] -----------------------------------------------
I20260201 09:00:09.629112 18612 test_util.cc:184] Had failures, leaving test files at /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1769936356186478-18612-0
[ FAILED ] TsTabletManagerITest.TestTableStats (36421 ms)
[ RUN ] TsTabletManagerITest.TestDeleteTableDuringTabletCopy
I20260201 09:00:09.634548 18612 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.45.62:39221
I20260201 09:00:09.635454 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 09:00:09.640300 20885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:09.640475 20886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:09.642047 20888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:09.643460 18612 server_base.cc:1060] running on GCE node
I20260201 09:00:09.644163 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 09:00:09.644378 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 09:00:09.644526 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936409644510 us; error 0 us; skew 500 ppm
I20260201 09:00:09.645058 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 09:00:09.649286 18612 webserver.cc:492] Webserver started at http://127.18.45.62:33947/ using document root <none> and password file <none>
I20260201 09:00:09.650031 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 09:00:09.650303 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 09:00:09.650624 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 09:00:09.651973 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1769936356186478-18612-0/minicluster-data/master-0-root/instance:
uuid: "0df99d1ffcea41a594014ff5b303ae85"
format_stamp: "Formatted at 2026-02-01 09:00:09 on dist-test-slave-zz6f"
I20260201 09:00:09.665112 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.012s user 0.007s sys 0.000s
I20260201 09:00:09.669893 20893 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:09.670770 18612 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260201 09:00:09.671032 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1769936356186478-18612-0/minicluster-data/master-0-root
uuid: "0df99d1ffcea41a594014ff5b303ae85"
format_stamp: "Formatted at 2026-02-01 09:00:09 on dist-test-slave-zz6f"
I20260201 09:00:09.671277 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1769936356186478-18612-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1769936356186478-18612-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1769936356186478-18612-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 09:00:09.688621 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 09:00:09.689843 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 09:00:09.722671 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.62:39221
I20260201 09:00:09.722752 20944 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.62:39221 every 8 connection(s)
I20260201 09:00:09.725960 20945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 09:00:09.734925 20945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85: Bootstrap starting.
I20260201 09:00:09.738929 20945 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85: Neither blocks nor log segments found. Creating new log.
I20260201 09:00:09.743101 20945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85: No bootstrap required, opened a new log
I20260201 09:00:09.745954 20945 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0df99d1ffcea41a594014ff5b303ae85" member_type: VOTER }
I20260201 09:00:09.746443 20945 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 09:00:09.746744 20945 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0df99d1ffcea41a594014ff5b303ae85, State: Initialized, Role: FOLLOWER
I20260201 09:00:09.747439 20945 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0df99d1ffcea41a594014ff5b303ae85" member_type: VOTER }
I20260201 09:00:09.748149 20945 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 09:00:09.748471 20945 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 09:00:09.748936 20945 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85 [term 0 FOLLOWER]: Advancing to term 1
I20260201 09:00:09.753883 20945 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0df99d1ffcea41a594014ff5b303ae85" member_type: VOTER }
I20260201 09:00:09.754333 20945 leader_election.cc:304] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0df99d1ffcea41a594014ff5b303ae85; no voters:
I20260201 09:00:09.755192 20945 leader_election.cc:290] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 09:00:09.755503 20948 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 09:00:09.756515 20948 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85 [term 1 LEADER]: Becoming Leader. State: Replica: 0df99d1ffcea41a594014ff5b303ae85, State: Running, Role: LEADER
I20260201 09:00:09.757073 20948 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0df99d1ffcea41a594014ff5b303ae85" member_type: VOTER }
I20260201 09:00:09.757728 20945 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85 [sys.catalog]: configured and running, proceeding with master startup.
I20260201 09:00:09.760684 20949 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0df99d1ffcea41a594014ff5b303ae85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0df99d1ffcea41a594014ff5b303ae85" member_type: VOTER } }
I20260201 09:00:09.761247 20949 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85 [sys.catalog]: This master's current role is: LEADER
I20260201 09:00:09.761072 20950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0df99d1ffcea41a594014ff5b303ae85. Latest consensus state: current_term: 1 leader_uuid: "0df99d1ffcea41a594014ff5b303ae85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0df99d1ffcea41a594014ff5b303ae85" member_type: VOTER } }
I20260201 09:00:09.762233 20950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85 [sys.catalog]: This master's current role is: LEADER
I20260201 09:00:09.768582 20956 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 09:00:09.772874 20956 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 09:00:09.773708 18612 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260201 09:00:09.779865 20956 catalog_manager.cc:1357] Generated new cluster ID: 89efd047607e466783e2689041b297bf
I20260201 09:00:09.780089 20956 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 09:00:09.807238 20956 catalog_manager.cc:1380] Generated new certificate authority record
I20260201 09:00:09.808341 20956 catalog_manager.cc:1514] Loading token signing keys...
I20260201 09:00:09.821228 20956 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85: Generated new TSK 0
I20260201 09:00:09.821671 20956 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 09:00:09.839339 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 09:00:09.844609 20966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:09.845487 20967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:09.846688 20969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:09.847541 18612 server_base.cc:1060] running on GCE node
I20260201 09:00:09.848335 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 09:00:09.848536 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 09:00:09.848682 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936409848664 us; error 0 us; skew 500 ppm
I20260201 09:00:09.849155 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 09:00:09.851060 18612 webserver.cc:492] Webserver started at http://127.18.45.1:42183/ using document root <none> and password file <none>
I20260201 09:00:09.851513 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 09:00:09.851693 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 09:00:09.851922 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 09:00:09.852891 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1769936356186478-18612-0/minicluster-data/ts-0-root/instance:
uuid: "b053e5cba5f34bf5b54dd89dfe1eb3e9"
format_stamp: "Formatted at 2026-02-01 09:00:09 on dist-test-slave-zz6f"
I20260201 09:00:09.856485 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260201 09:00:09.859316 20974 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:09.859862 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260201 09:00:09.860093 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1769936356186478-18612-0/minicluster-data/ts-0-root
uuid: "b053e5cba5f34bf5b54dd89dfe1eb3e9"
format_stamp: "Formatted at 2026-02-01 09:00:09 on dist-test-slave-zz6f"
I20260201 09:00:09.860363 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1769936356186478-18612-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1769936356186478-18612-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1769936356186478-18612-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 09:00:09.887696 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 09:00:09.888675 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 09:00:09.889886 18612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 09:00:09.891713 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 09:00:09.891891 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:09.892082 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 09:00:09.892216 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:09.926723 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.1:44517
I20260201 09:00:09.926811 21036 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.1:44517 every 8 connection(s)
I20260201 09:00:09.930490 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 09:00:09.936607 21041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:09.937083 21042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:09.939494 21044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:09.939829 18612 server_base.cc:1060] running on GCE node
I20260201 09:00:09.940600 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 09:00:09.940791 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 09:00:09.940958 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936409940944 us; error 0 us; skew 500 ppm
I20260201 09:00:09.941370 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 09:00:09.943650 18612 webserver.cc:492] Webserver started at http://127.18.45.2:35999/ using document root <none> and password file <none>
I20260201 09:00:09.944200 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 09:00:09.944389 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 09:00:09.944665 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 09:00:09.945600 21037 heartbeater.cc:344] Connected to a master server at 127.18.45.62:39221
I20260201 09:00:09.945926 21037 heartbeater.cc:461] Registering TS with master...
I20260201 09:00:09.945842 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1769936356186478-18612-0/minicluster-data/ts-1-root/instance:
uuid: "d51885b0543845fd886e1fc3f71aaed5"
format_stamp: "Formatted at 2026-02-01 09:00:09 on dist-test-slave-zz6f"
I20260201 09:00:09.946640 21037 heartbeater.cc:507] Master 127.18.45.62:39221 requested a full tablet report, sending...
I20260201 09:00:09.948480 20910 ts_manager.cc:194] Registered new tserver with Master: b053e5cba5f34bf5b54dd89dfe1eb3e9 (127.18.45.1:44517)
I20260201 09:00:09.950297 20910 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54414
I20260201 09:00:09.950599 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260201 09:00:09.954133 21049 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:09.954741 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260201 09:00:09.954973 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1769936356186478-18612-0/minicluster-data/ts-1-root
uuid: "d51885b0543845fd886e1fc3f71aaed5"
format_stamp: "Formatted at 2026-02-01 09:00:09 on dist-test-slave-zz6f"
I20260201 09:00:09.955188 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1769936356186478-18612-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1769936356186478-18612-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1769936356186478-18612-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 09:00:09.970162 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 09:00:09.971062 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 09:00:09.972188 18612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 09:00:09.974123 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 09:00:09.974285 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:09.974488 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 09:00:09.974622 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:10.008154 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.2:44605
I20260201 09:00:10.008245 21111 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.2:44605 every 8 connection(s)
I20260201 09:00:10.012167 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 09:00:10.017269 21115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:10.018539 21116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:10.021929 21118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:10.022420 21112 heartbeater.cc:344] Connected to a master server at 127.18.45.62:39221
I20260201 09:00:10.022691 18612 server_base.cc:1060] running on GCE node
I20260201 09:00:10.022751 21112 heartbeater.cc:461] Registering TS with master...
I20260201 09:00:10.023658 21112 heartbeater.cc:507] Master 127.18.45.62:39221 requested a full tablet report, sending...
I20260201 09:00:10.023669 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 09:00:10.024119 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 09:00:10.024317 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936410024300 us; error 0 us; skew 500 ppm
I20260201 09:00:10.024974 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 09:00:10.025678 20910 ts_manager.cc:194] Registered new tserver with Master: d51885b0543845fd886e1fc3f71aaed5 (127.18.45.2:44605)
I20260201 09:00:10.027263 18612 webserver.cc:492] Webserver started at http://127.18.45.3:40727/ using document root <none> and password file <none>
I20260201 09:00:10.027371 20910 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54424
I20260201 09:00:10.027860 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 09:00:10.028108 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 09:00:10.028307 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 09:00:10.029589 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1769936356186478-18612-0/minicluster-data/ts-2-root/instance:
uuid: "88222a73821649dbb3a010bdeee5a697"
format_stamp: "Formatted at 2026-02-01 09:00:10 on dist-test-slave-zz6f"
I20260201 09:00:10.033391 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260201 09:00:10.036134 21123 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:10.036741 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260201 09:00:10.037014 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1769936356186478-18612-0/minicluster-data/ts-2-root
uuid: "88222a73821649dbb3a010bdeee5a697"
format_stamp: "Formatted at 2026-02-01 09:00:10 on dist-test-slave-zz6f"
I20260201 09:00:10.037230 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1769936356186478-18612-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1769936356186478-18612-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1769936356186478-18612-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 09:00:10.059151 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 09:00:10.060034 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 09:00:10.061228 18612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 09:00:10.063031 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 09:00:10.063203 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:10.063413 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 09:00:10.063555 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:10.097468 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.3:38735
I20260201 09:00:10.097560 21185 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.3:38735 every 8 connection(s)
I20260201 09:00:10.109047 21186 heartbeater.cc:344] Connected to a master server at 127.18.45.62:39221
I20260201 09:00:10.109376 21186 heartbeater.cc:461] Registering TS with master...
I20260201 09:00:10.109988 21186 heartbeater.cc:507] Master 127.18.45.62:39221 requested a full tablet report, sending...
I20260201 09:00:10.111498 20910 ts_manager.cc:194] Registered new tserver with Master: 88222a73821649dbb3a010bdeee5a697 (127.18.45.3:38735)
I20260201 09:00:10.112164 18612 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.011890912s
I20260201 09:00:10.112571 20910 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54432
I20260201 09:00:10.138280 20910 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54436:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
}
}
W20260201 09:00:10.139781 20910 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260201 09:00:10.178184 21077 tablet_service.cc:1505] Processing CreateTablet for tablet 98fdb63b30a9432f9aca465d6dda59a7 (DEFAULT_TABLE table=test-table [id=26af17d3bdb94f97b69542acb5eeece6]), partition=
I20260201 09:00:10.179304 21077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98fdb63b30a9432f9aca465d6dda59a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 09:00:10.180032 21151 tablet_service.cc:1505] Processing CreateTablet for tablet 98fdb63b30a9432f9aca465d6dda59a7 (DEFAULT_TABLE table=test-table [id=26af17d3bdb94f97b69542acb5eeece6]), partition=
I20260201 09:00:10.180986 21151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98fdb63b30a9432f9aca465d6dda59a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 09:00:10.181419 21002 tablet_service.cc:1505] Processing CreateTablet for tablet 98fdb63b30a9432f9aca465d6dda59a7 (DEFAULT_TABLE table=test-table [id=26af17d3bdb94f97b69542acb5eeece6]), partition=
I20260201 09:00:10.182112 21002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98fdb63b30a9432f9aca465d6dda59a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 09:00:10.193490 21202 tablet_bootstrap.cc:492] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9: Bootstrap starting.
I20260201 09:00:10.194602 21203 tablet_bootstrap.cc:492] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: Bootstrap starting.
I20260201 09:00:10.197866 21204 tablet_bootstrap.cc:492] T 98fdb63b30a9432f9aca465d6dda59a7 P 88222a73821649dbb3a010bdeee5a697: Bootstrap starting.
I20260201 09:00:10.200292 21203 tablet_bootstrap.cc:654] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: Neither blocks nor log segments found. Creating new log.
I20260201 09:00:10.201135 21202 tablet_bootstrap.cc:654] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9: Neither blocks nor log segments found. Creating new log.
I20260201 09:00:10.202382 21204 tablet_bootstrap.cc:654] T 98fdb63b30a9432f9aca465d6dda59a7 P 88222a73821649dbb3a010bdeee5a697: Neither blocks nor log segments found. Creating new log.
I20260201 09:00:10.205209 21203 tablet_bootstrap.cc:492] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: No bootstrap required, opened a new log
I20260201 09:00:10.205693 21203 ts_tablet_manager.cc:1403] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.005s
I20260201 09:00:10.206422 21204 tablet_bootstrap.cc:492] T 98fdb63b30a9432f9aca465d6dda59a7 P 88222a73821649dbb3a010bdeee5a697: No bootstrap required, opened a new log
I20260201 09:00:10.206746 21204 ts_tablet_manager.cc:1403] T 98fdb63b30a9432f9aca465d6dda59a7 P 88222a73821649dbb3a010bdeee5a697: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s
I20260201 09:00:10.207273 21202 tablet_bootstrap.cc:492] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9: No bootstrap required, opened a new log
I20260201 09:00:10.207638 21202 ts_tablet_manager.cc:1403] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.005s
I20260201 09:00:10.207842 21203 raft_consensus.cc:359] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51885b0543845fd886e1fc3f71aaed5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 44605 } } peers { permanent_uuid: "88222a73821649dbb3a010bdeee5a697" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38735 } } peers { permanent_uuid: "b053e5cba5f34bf5b54dd89dfe1eb3e9" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 44517 } }
I20260201 09:00:10.208516 21203 raft_consensus.cc:385] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 09:00:10.208786 21203 raft_consensus.cc:740] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d51885b0543845fd886e1fc3f71aaed5, State: Initialized, Role: FOLLOWER
I20260201 09:00:10.208781 21204 raft_consensus.cc:359] T 98fdb63b30a9432f9aca465d6dda59a7 P 88222a73821649dbb3a010bdeee5a697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51885b0543845fd886e1fc3f71aaed5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 44605 } } peers { permanent_uuid: "88222a73821649dbb3a010bdeee5a697" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38735 } } peers { permanent_uuid: "b053e5cba5f34bf5b54dd89dfe1eb3e9" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 44517 } }
I20260201 09:00:10.209580 21204 raft_consensus.cc:385] T 98fdb63b30a9432f9aca465d6dda59a7 P 88222a73821649dbb3a010bdeee5a697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 09:00:10.209885 21204 raft_consensus.cc:740] T 98fdb63b30a9432f9aca465d6dda59a7 P 88222a73821649dbb3a010bdeee5a697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88222a73821649dbb3a010bdeee5a697, State: Initialized, Role: FOLLOWER
I20260201 09:00:10.209802 21203 consensus_queue.cc:260] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51885b0543845fd886e1fc3f71aaed5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 44605 } } peers { permanent_uuid: "88222a73821649dbb3a010bdeee5a697" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38735 } } peers { permanent_uuid: "b053e5cba5f34bf5b54dd89dfe1eb3e9" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 44517 } }
I20260201 09:00:10.210601 21204 consensus_queue.cc:260] T 98fdb63b30a9432f9aca465d6dda59a7 P 88222a73821649dbb3a010bdeee5a697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51885b0543845fd886e1fc3f71aaed5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 44605 } } peers { permanent_uuid: "88222a73821649dbb3a010bdeee5a697" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38735 } } peers { permanent_uuid: "b053e5cba5f34bf5b54dd89dfe1eb3e9" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 44517 } }
I20260201 09:00:10.210758 21202 raft_consensus.cc:359] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51885b0543845fd886e1fc3f71aaed5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 44605 } } peers { permanent_uuid: "88222a73821649dbb3a010bdeee5a697" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38735 } } peers { permanent_uuid: "b053e5cba5f34bf5b54dd89dfe1eb3e9" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 44517 } }
I20260201 09:00:10.211510 21202 raft_consensus.cc:385] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 09:00:10.211841 21202 raft_consensus.cc:740] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b053e5cba5f34bf5b54dd89dfe1eb3e9, State: Initialized, Role: FOLLOWER
I20260201 09:00:10.212596 21186 heartbeater.cc:499] Master 127.18.45.62:39221 was elected leader, sending a full tablet report...
I20260201 09:00:10.213017 21204 ts_tablet_manager.cc:1434] T 98fdb63b30a9432f9aca465d6dda59a7 P 88222a73821649dbb3a010bdeee5a697: Time spent starting tablet: real 0.006s user 0.001s sys 0.007s
I20260201 09:00:10.212683 21202 consensus_queue.cc:260] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51885b0543845fd886e1fc3f71aaed5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 44605 } } peers { permanent_uuid: "88222a73821649dbb3a010bdeee5a697" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38735 } } peers { permanent_uuid: "b053e5cba5f34bf5b54dd89dfe1eb3e9" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 44517 } }
W20260201 09:00:10.213246 21204 ts_tablet_manager.cc:1457] Injecting 50ms of latency into OpenTablet
I20260201 09:00:10.214818 21037 heartbeater.cc:499] Master 127.18.45.62:39221 was elected leader, sending a full tablet report...
I20260201 09:00:10.219934 21202 ts_tablet_manager.cc:1434] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9: Time spent starting tablet: real 0.012s user 0.007s sys 0.001s
W20260201 09:00:10.220279 21202 ts_tablet_manager.cc:1457] Injecting 50ms of latency into OpenTablet
I20260201 09:00:10.221486 21112 heartbeater.cc:499] Master 127.18.45.62:39221 was elected leader, sending a full tablet report...
I20260201 09:00:10.221937 21203 ts_tablet_manager.cc:1434] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: Time spent starting tablet: real 0.016s user 0.004s sys 0.010s
W20260201 09:00:10.222169 21203 ts_tablet_manager.cc:1457] Injecting 50ms of latency into OpenTablet
W20260201 09:00:10.261175 21113 tablet.cc:2378] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260201 09:00:10.264922 21210 raft_consensus.cc:493] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:10.265307 21210 raft_consensus.cc:515] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51885b0543845fd886e1fc3f71aaed5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 44605 } } peers { permanent_uuid: "88222a73821649dbb3a010bdeee5a697" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38735 } } peers { permanent_uuid: "b053e5cba5f34bf5b54dd89dfe1eb3e9" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 44517 } }
I20260201 09:00:10.267141 21210 leader_election.cc:290] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d51885b0543845fd886e1fc3f71aaed5 (127.18.45.2:44605), 88222a73821649dbb3a010bdeee5a697 (127.18.45.3:38735)
I20260201 09:00:10.277036 21087 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98fdb63b30a9432f9aca465d6dda59a7" candidate_uuid: "b053e5cba5f34bf5b54dd89dfe1eb3e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51885b0543845fd886e1fc3f71aaed5" is_pre_election: true
I20260201 09:00:10.277694 21087 raft_consensus.cc:2468] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b053e5cba5f34bf5b54dd89dfe1eb3e9 in term 0.
I20260201 09:00:10.277880 21161 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98fdb63b30a9432f9aca465d6dda59a7" candidate_uuid: "b053e5cba5f34bf5b54dd89dfe1eb3e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88222a73821649dbb3a010bdeee5a697" is_pre_election: true
I20260201 09:00:10.278486 21161 raft_consensus.cc:2468] T 98fdb63b30a9432f9aca465d6dda59a7 P 88222a73821649dbb3a010bdeee5a697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b053e5cba5f34bf5b54dd89dfe1eb3e9 in term 0.
I20260201 09:00:10.278820 20978 leader_election.cc:304] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b053e5cba5f34bf5b54dd89dfe1eb3e9, d51885b0543845fd886e1fc3f71aaed5; no voters:
I20260201 09:00:10.279430 21210 raft_consensus.cc:2804] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 09:00:10.279712 21210 raft_consensus.cc:493] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:10.279919 21210 raft_consensus.cc:3060] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9 [term 0 FOLLOWER]: Advancing to term 1
I20260201 09:00:10.283694 21210 raft_consensus.cc:515] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51885b0543845fd886e1fc3f71aaed5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 44605 } } peers { permanent_uuid: "88222a73821649dbb3a010bdeee5a697" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38735 } } peers { permanent_uuid: "b053e5cba5f34bf5b54dd89dfe1eb3e9" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 44517 } }
I20260201 09:00:10.284945 21210 leader_election.cc:290] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9 [CANDIDATE]: Term 1 election: Requested vote from peers d51885b0543845fd886e1fc3f71aaed5 (127.18.45.2:44605), 88222a73821649dbb3a010bdeee5a697 (127.18.45.3:38735)
I20260201 09:00:10.285506 21087 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98fdb63b30a9432f9aca465d6dda59a7" candidate_uuid: "b053e5cba5f34bf5b54dd89dfe1eb3e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51885b0543845fd886e1fc3f71aaed5"
I20260201 09:00:10.285786 21161 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98fdb63b30a9432f9aca465d6dda59a7" candidate_uuid: "b053e5cba5f34bf5b54dd89dfe1eb3e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88222a73821649dbb3a010bdeee5a697"
I20260201 09:00:10.285909 21087 raft_consensus.cc:3060] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5 [term 0 FOLLOWER]: Advancing to term 1
I20260201 09:00:10.286243 21161 raft_consensus.cc:3060] T 98fdb63b30a9432f9aca465d6dda59a7 P 88222a73821649dbb3a010bdeee5a697 [term 0 FOLLOWER]: Advancing to term 1
I20260201 09:00:10.289959 21087 raft_consensus.cc:2468] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b053e5cba5f34bf5b54dd89dfe1eb3e9 in term 1.
I20260201 09:00:10.290083 21161 raft_consensus.cc:2468] T 98fdb63b30a9432f9aca465d6dda59a7 P 88222a73821649dbb3a010bdeee5a697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b053e5cba5f34bf5b54dd89dfe1eb3e9 in term 1.
I20260201 09:00:10.290716 20978 leader_election.cc:304] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b053e5cba5f34bf5b54dd89dfe1eb3e9, d51885b0543845fd886e1fc3f71aaed5; no voters:
I20260201 09:00:10.291270 21210 raft_consensus.cc:2804] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 09:00:10.291970 21210 raft_consensus.cc:697] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9 [term 1 LEADER]: Becoming Leader. State: Replica: b053e5cba5f34bf5b54dd89dfe1eb3e9, State: Running, Role: LEADER
I20260201 09:00:10.292588 21210 consensus_queue.cc:237] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51885b0543845fd886e1fc3f71aaed5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 44605 } } peers { permanent_uuid: "88222a73821649dbb3a010bdeee5a697" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38735 } } peers { permanent_uuid: "b053e5cba5f34bf5b54dd89dfe1eb3e9" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 44517 } }
I20260201 09:00:10.299259 20910 catalog_manager.cc:5654] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b053e5cba5f34bf5b54dd89dfe1eb3e9 (127.18.45.1). New cstate: current_term: 1 leader_uuid: "b053e5cba5f34bf5b54dd89dfe1eb3e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51885b0543845fd886e1fc3f71aaed5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 44605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88222a73821649dbb3a010bdeee5a697" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b053e5cba5f34bf5b54dd89dfe1eb3e9" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 44517 } health_report { overall_health: HEALTHY } } }
I20260201 09:00:10.347524 21077 tablet_service.cc:1552] Processing DeleteTablet for tablet 98fdb63b30a9432f9aca465d6dda59a7 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:35136
I20260201 09:00:10.348632 21215 tablet_replica.cc:333] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: stopping tablet replica
I20260201 09:00:10.349170 21215 raft_consensus.cc:2243] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 09:00:10.349541 21215 raft_consensus.cc:2272] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:10.351385 21215 ts_tablet_manager.cc:1916] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 09:00:10.359990 21215 ts_tablet_manager.cc:1929] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 0.0
I20260201 09:00:10.360287 21215 log.cc:1199] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: Deleting WAL directory at /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1769936356186478-18612-0/minicluster-data/ts-1-root/wals/98fdb63b30a9432f9aca465d6dda59a7
I20260201 09:00:10.363294 21216 ts_tablet_manager.cc:933] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: Initiating tablet copy from peer b053e5cba5f34bf5b54dd89dfe1eb3e9 (127.18.45.1:44517)
I20260201 09:00:10.364564 21216 tablet_copy_client.cc:323] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: tablet copy: Beginning tablet copy session from remote peer at address 127.18.45.1:44517
I20260201 09:00:10.370908 21022 tablet_copy_service.cc:140] P b053e5cba5f34bf5b54dd89dfe1eb3e9: Received BeginTabletCopySession request for tablet 98fdb63b30a9432f9aca465d6dda59a7 from peer d51885b0543845fd886e1fc3f71aaed5 ({username='slave'} at 127.0.0.1:38462)
I20260201 09:00:10.371224 21022 tablet_copy_service.cc:161] P b053e5cba5f34bf5b54dd89dfe1eb3e9: Beginning new tablet copy session on tablet 98fdb63b30a9432f9aca465d6dda59a7 from peer d51885b0543845fd886e1fc3f71aaed5 at {username='slave'} at 127.0.0.1:38462: session id = d51885b0543845fd886e1fc3f71aaed5-98fdb63b30a9432f9aca465d6dda59a7
I20260201 09:00:10.375478 21022 tablet_copy_source_session.cc:215] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 09:00:10.377298 21216 ts_tablet_manager.cc:1916] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260201 09:00:10.385393 21216 ts_tablet_manager.cc:1929] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 0.0
I20260201 09:00:10.385874 21216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98fdb63b30a9432f9aca465d6dda59a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 09:00:10.389782 21216 tablet_copy_client.cc:806] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: tablet copy: Starting download of 0 data blocks...
I20260201 09:00:10.390208 21216 tablet_copy_client.cc:670] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: tablet copy: Starting download of 1 WAL segments...
I20260201 09:00:10.391345 20910 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54438:
table { table_id: "26af17d3bdb94f97b69542acb5eeece6" table_name: "test-table" }
I20260201 09:00:10.391906 20910 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54438:
table { table_id: "26af17d3bdb94f97b69542acb5eeece6" table_name: "test-table" }
I20260201 09:00:10.393357 21216 tablet_copy_client.cc:538] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 09:00:10.398409 21216 tablet_bootstrap.cc:492] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: Bootstrap starting.
I20260201 09:00:10.400583 20910 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85: Sending DeleteTablet for 3 replicas of tablet 98fdb63b30a9432f9aca465d6dda59a7
I20260201 09:00:10.402181 21077 tablet_service.cc:1552] Processing DeleteTablet for tablet 98fdb63b30a9432f9aca465d6dda59a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-02-01 09:00:10 UTC) from {username='slave'} at 127.0.0.1:35128
I20260201 09:00:10.402611 21151 tablet_service.cc:1552] Processing DeleteTablet for tablet 98fdb63b30a9432f9aca465d6dda59a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-02-01 09:00:10 UTC) from {username='slave'} at 127.0.0.1:60442
I20260201 09:00:10.402941 21002 tablet_service.cc:1552] Processing DeleteTablet for tablet 98fdb63b30a9432f9aca465d6dda59a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-02-01 09:00:10 UTC) from {username='slave'} at 127.0.0.1:38442
W20260201 09:00:10.404031 20897 catalog_manager.cc:4965] TS d51885b0543845fd886e1fc3f71aaed5 (127.18.45.2:44605): delete failed for tablet 98fdb63b30a9432f9aca465d6dda59a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98fdb63b30a9432f9aca465d6dda59a7 already in progress: copying tablet
I20260201 09:00:10.404524 21218 tablet_replica.cc:333] T 98fdb63b30a9432f9aca465d6dda59a7 P 88222a73821649dbb3a010bdeee5a697: stopping tablet replica
I20260201 09:00:10.404793 21219 tablet_replica.cc:333] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9: stopping tablet replica
I20260201 09:00:10.405303 21218 raft_consensus.cc:2243] T 98fdb63b30a9432f9aca465d6dda59a7 P 88222a73821649dbb3a010bdeee5a697 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 09:00:10.405473 21219 raft_consensus.cc:2243] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9 [term 1 LEADER]: Raft consensus shutting down.
I20260201 09:00:10.405781 21218 raft_consensus.cc:2272] T 98fdb63b30a9432f9aca465d6dda59a7 P 88222a73821649dbb3a010bdeee5a697 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:10.406131 21219 pending_rounds.cc:70] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9: Trying to abort 1 pending ops.
I20260201 09:00:10.406373 21219 pending_rounds.cc:77] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7249659536564088832 op_type: NO_OP noop_request { }
I20260201 09:00:10.406759 21219 raft_consensus.cc:2889] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260201 09:00:10.407145 21219 raft_consensus.cc:2272] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:10.408329 21218 ts_tablet_manager.cc:1916] T 98fdb63b30a9432f9aca465d6dda59a7 P 88222a73821649dbb3a010bdeee5a697: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260201 09:00:10.409951 21219 ts_tablet_manager.cc:1916] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260201 09:00:10.412793 21216 tablet_bootstrap.cc:492] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260201 09:00:10.413424 21216 tablet_bootstrap.cc:492] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: Bootstrap complete.
I20260201 09:00:10.413936 21216 ts_tablet_manager.cc:1403] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.006s
I20260201 09:00:10.415884 21216 raft_consensus.cc:359] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51885b0543845fd886e1fc3f71aaed5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 44605 } } peers { permanent_uuid: "88222a73821649dbb3a010bdeee5a697" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38735 } } peers { permanent_uuid: "b053e5cba5f34bf5b54dd89dfe1eb3e9" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 44517 } }
I20260201 09:00:10.416447 21216 raft_consensus.cc:740] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d51885b0543845fd886e1fc3f71aaed5, State: Initialized, Role: FOLLOWER
I20260201 09:00:10.417001 21216 consensus_queue.cc:260] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51885b0543845fd886e1fc3f71aaed5" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 44605 } } peers { permanent_uuid: "88222a73821649dbb3a010bdeee5a697" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 38735 } } peers { permanent_uuid: "b053e5cba5f34bf5b54dd89dfe1eb3e9" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 44517 } }
I20260201 09:00:10.418653 21216 ts_tablet_manager.cc:1434] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
W20260201 09:00:10.418879 21216 ts_tablet_manager.cc:1457] Injecting 50ms of latency into OpenTablet
I20260201 09:00:10.421342 21218 ts_tablet_manager.cc:1929] T 98fdb63b30a9432f9aca465d6dda59a7 P 88222a73821649dbb3a010bdeee5a697: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260201 09:00:10.421710 21218 log.cc:1199] T 98fdb63b30a9432f9aca465d6dda59a7 P 88222a73821649dbb3a010bdeee5a697: Deleting WAL directory at /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1769936356186478-18612-0/minicluster-data/ts-2-root/wals/98fdb63b30a9432f9aca465d6dda59a7
I20260201 09:00:10.422438 21218 ts_tablet_manager.cc:1950] T 98fdb63b30a9432f9aca465d6dda59a7 P 88222a73821649dbb3a010bdeee5a697: Deleting consensus metadata
I20260201 09:00:10.423189 21077 tablet_service.cc:1552] Processing DeleteTablet for tablet 98fdb63b30a9432f9aca465d6dda59a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-02-01 09:00:10 UTC) from {username='slave'} at 127.0.0.1:35128
I20260201 09:00:10.424201 21219 ts_tablet_manager.cc:1929] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260201 09:00:10.424551 21219 log.cc:1199] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9: Deleting WAL directory at /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1769936356186478-18612-0/minicluster-data/ts-0-root/wals/98fdb63b30a9432f9aca465d6dda59a7
W20260201 09:00:10.424479 20897 catalog_manager.cc:4965] TS d51885b0543845fd886e1fc3f71aaed5 (127.18.45.2:44605): delete failed for tablet 98fdb63b30a9432f9aca465d6dda59a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98fdb63b30a9432f9aca465d6dda59a7 already in progress: copying tablet
I20260201 09:00:10.425217 21219 ts_tablet_manager.cc:1950] T 98fdb63b30a9432f9aca465d6dda59a7 P b053e5cba5f34bf5b54dd89dfe1eb3e9: Deleting consensus metadata
I20260201 09:00:10.425549 20896 catalog_manager.cc:4985] TS 88222a73821649dbb3a010bdeee5a697 (127.18.45.3:38735): tablet 98fdb63b30a9432f9aca465d6dda59a7 (table test-table [id=26af17d3bdb94f97b69542acb5eeece6]) successfully deleted
I20260201 09:00:10.426373 20894 catalog_manager.cc:4985] TS b053e5cba5f34bf5b54dd89dfe1eb3e9 (127.18.45.1:44517): tablet 98fdb63b30a9432f9aca465d6dda59a7 (table test-table [id=26af17d3bdb94f97b69542acb5eeece6]) successfully deleted
I20260201 09:00:10.470351 21022 tablet_copy_service.cc:342] P b053e5cba5f34bf5b54dd89dfe1eb3e9: Request end of tablet copy session d51885b0543845fd886e1fc3f71aaed5-98fdb63b30a9432f9aca465d6dda59a7 received from {username='slave'} at 127.0.0.1:38462
I20260201 09:00:10.470758 21022 tablet_copy_service.cc:434] P b053e5cba5f34bf5b54dd89dfe1eb3e9: ending tablet copy session d51885b0543845fd886e1fc3f71aaed5-98fdb63b30a9432f9aca465d6dda59a7 on tablet 98fdb63b30a9432f9aca465d6dda59a7 with peer d51885b0543845fd886e1fc3f71aaed5
I20260201 09:00:10.473289 21077 tablet_service.cc:1552] Processing DeleteTablet for tablet 98fdb63b30a9432f9aca465d6dda59a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-02-01 09:00:10 UTC) from {username='slave'} at 127.0.0.1:35128
I20260201 09:00:10.473902 21215 tablet_replica.cc:333] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: stopping tablet replica
I20260201 09:00:10.474352 21215 raft_consensus.cc:2243] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 09:00:10.474660 21215 pending_rounds.cc:70] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: Trying to abort 1 pending ops.
I20260201 09:00:10.474846 21215 pending_rounds.cc:77] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7249659536564088832 op_type: NO_OP noop_request { }
I20260201 09:00:10.475117 21215 raft_consensus.cc:2889] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260201 09:00:10.475409 21215 raft_consensus.cc:2272] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:10.477191 21215 ts_tablet_manager.cc:1916] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260201 09:00:10.485141 21215 ts_tablet_manager.cc:1929] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260201 09:00:10.485401 21215 log.cc:1199] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: Deleting WAL directory at /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1769936356186478-18612-0/minicluster-data/ts-1-root/wals/98fdb63b30a9432f9aca465d6dda59a7
I20260201 09:00:10.485922 21215 ts_tablet_manager.cc:1950] T 98fdb63b30a9432f9aca465d6dda59a7 P d51885b0543845fd886e1fc3f71aaed5: Deleting consensus metadata
I20260201 09:00:10.487593 20897 catalog_manager.cc:4985] TS d51885b0543845fd886e1fc3f71aaed5 (127.18.45.2:44605): tablet 98fdb63b30a9432f9aca465d6dda59a7 (table test-table [id=26af17d3bdb94f97b69542acb5eeece6]) successfully deleted
I20260201 09:00:10.538300 18612 tablet_server.cc:178] TabletServer@127.18.45.1:0 shutting down...
I20260201 09:00:10.555073 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 09:00:10.570966 18612 tablet_server.cc:195] TabletServer@127.18.45.1:0 shutdown complete.
I20260201 09:00:10.578464 18612 tablet_server.cc:178] TabletServer@127.18.45.2:0 shutting down...
I20260201 09:00:10.592036 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 09:00:10.606988 18612 tablet_server.cc:195] TabletServer@127.18.45.2:0 shutdown complete.
I20260201 09:00:10.614223 18612 tablet_server.cc:178] TabletServer@127.18.45.3:0 shutting down...
I20260201 09:00:10.627946 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 09:00:10.642719 18612 tablet_server.cc:195] TabletServer@127.18.45.3:0 shutdown complete.
I20260201 09:00:10.649402 18612 master.cc:561] Master@127.18.45.62:39221 shutting down...
I20260201 09:00:10.661541 18612 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85 [term 1 LEADER]: Raft consensus shutting down.
I20260201 09:00:10.661967 18612 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:10.662262 18612 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0df99d1ffcea41a594014ff5b303ae85: stopping tablet replica
I20260201 09:00:10.679502 18612 master.cc:583] Master@127.18.45.62:39221 shutdown complete.
[ OK ] TsTabletManagerITest.TestDeleteTableDuringTabletCopy (1065 ms)
[----------] 4 tests from TsTabletManagerITest (44553 ms total)
[----------] 4 tests from TxnStatusTabletManagementTest
[ RUN ] TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet
I20260201 09:00:10.699551 18612 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.45.62:42337
I20260201 09:00:10.700327 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 09:00:10.704157 21225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:10.705292 21226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:10.706600 18612 server_base.cc:1060] running on GCE node
W20260201 09:00:10.707297 21228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:10.707911 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 09:00:10.708084 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 09:00:10.708230 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936410708198 us; error 0 us; skew 500 ppm
I20260201 09:00:10.708696 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 09:00:10.710656 18612 webserver.cc:492] Webserver started at http://127.18.45.62:45963/ using document root <none> and password file <none>
I20260201 09:00:10.711092 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 09:00:10.711267 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 09:00:10.711539 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 09:00:10.712441 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/master-0-root/instance:
uuid: "79ce5158fc0f401695f33bc91f49b63e"
format_stamp: "Formatted at 2026-02-01 09:00:10 on dist-test-slave-zz6f"
I20260201 09:00:10.716177 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260201 09:00:10.718989 21233 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:10.719568 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260201 09:00:10.719803 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/master-0-root
uuid: "79ce5158fc0f401695f33bc91f49b63e"
format_stamp: "Formatted at 2026-02-01 09:00:10 on dist-test-slave-zz6f"
I20260201 09:00:10.720031 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 09:00:10.731671 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 09:00:10.732709 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 09:00:10.763407 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.62:42337
I20260201 09:00:10.763525 21284 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.62:42337 every 8 connection(s)
I20260201 09:00:10.766714 21285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 09:00:10.775468 21285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e: Bootstrap starting.
I20260201 09:00:10.779209 21285 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e: Neither blocks nor log segments found. Creating new log.
I20260201 09:00:10.782330 21285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e: No bootstrap required, opened a new log
I20260201 09:00:10.783887 21285 raft_consensus.cc:359] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79ce5158fc0f401695f33bc91f49b63e" member_type: VOTER }
I20260201 09:00:10.784185 21285 raft_consensus.cc:385] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 09:00:10.784394 21285 raft_consensus.cc:740] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ce5158fc0f401695f33bc91f49b63e, State: Initialized, Role: FOLLOWER
I20260201 09:00:10.784930 21285 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79ce5158fc0f401695f33bc91f49b63e" member_type: VOTER }
I20260201 09:00:10.785333 21285 raft_consensus.cc:399] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 09:00:10.785524 21285 raft_consensus.cc:493] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 09:00:10.785750 21285 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e [term 0 FOLLOWER]: Advancing to term 1
I20260201 09:00:10.789228 21285 raft_consensus.cc:515] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79ce5158fc0f401695f33bc91f49b63e" member_type: VOTER }
I20260201 09:00:10.789659 21285 leader_election.cc:304] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 79ce5158fc0f401695f33bc91f49b63e; no voters:
I20260201 09:00:10.790607 21285 leader_election.cc:290] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 09:00:10.790879 21288 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e [term 1 FOLLOWER]: Leader election won for term 1
I20260201 09:00:10.792096 21288 raft_consensus.cc:697] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e [term 1 LEADER]: Becoming Leader. State: Replica: 79ce5158fc0f401695f33bc91f49b63e, State: Running, Role: LEADER
I20260201 09:00:10.792658 21288 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79ce5158fc0f401695f33bc91f49b63e" member_type: VOTER }
I20260201 09:00:10.793241 21285 sys_catalog.cc:565] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e [sys.catalog]: configured and running, proceeding with master startup.
I20260201 09:00:10.795563 21290 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79ce5158fc0f401695f33bc91f49b63e. Latest consensus state: current_term: 1 leader_uuid: "79ce5158fc0f401695f33bc91f49b63e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79ce5158fc0f401695f33bc91f49b63e" member_type: VOTER } }
I20260201 09:00:10.795473 21289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "79ce5158fc0f401695f33bc91f49b63e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79ce5158fc0f401695f33bc91f49b63e" member_type: VOTER } }
I20260201 09:00:10.796145 21290 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e [sys.catalog]: This master's current role is: LEADER
I20260201 09:00:10.796201 21289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e [sys.catalog]: This master's current role is: LEADER
I20260201 09:00:10.798930 21293 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 09:00:10.806186 21293 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 09:00:10.806990 18612 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260201 09:00:10.813314 21293 catalog_manager.cc:1357] Generated new cluster ID: 27fc75fc9848464d8462e2d5dea8c341
I20260201 09:00:10.813563 21293 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 09:00:10.839901 21293 catalog_manager.cc:1380] Generated new certificate authority record
I20260201 09:00:10.841032 21293 catalog_manager.cc:1514] Loading token signing keys...
I20260201 09:00:10.853660 21293 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e: Generated new TSK 0
I20260201 09:00:10.854103 21293 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 09:00:10.872462 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 09:00:10.877632 21306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:10.878616 21307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:10.880084 18612 server_base.cc:1060] running on GCE node
W20260201 09:00:10.880115 21309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:10.881026 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 09:00:10.881217 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 09:00:10.881407 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936410881389 us; error 0 us; skew 500 ppm
I20260201 09:00:10.881894 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 09:00:10.883806 18612 webserver.cc:492] Webserver started at http://127.18.45.1:34243/ using document root <none> and password file <none>
I20260201 09:00:10.884255 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 09:00:10.884440 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 09:00:10.884684 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 09:00:10.885643 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/ts-0-root/instance:
uuid: "b4a7837640564db8897250c626b1441c"
format_stamp: "Formatted at 2026-02-01 09:00:10 on dist-test-slave-zz6f"
I20260201 09:00:10.889371 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260201 09:00:10.892048 21314 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:10.892766 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260201 09:00:10.893030 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/ts-0-root
uuid: "b4a7837640564db8897250c626b1441c"
format_stamp: "Formatted at 2026-02-01 09:00:10 on dist-test-slave-zz6f"
I20260201 09:00:10.893237 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 09:00:10.902072 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 09:00:10.902964 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 09:00:10.907150 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 09:00:10.907461 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:10.907745 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 09:00:10.907953 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:10.952562 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.1:45051
I20260201 09:00:10.952641 21384 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.1:45051 every 8 connection(s)
I20260201 09:00:10.956408 21385 heartbeater.cc:344] Connected to a master server at 127.18.45.62:42337
I20260201 09:00:10.956743 21385 heartbeater.cc:461] Registering TS with master...
I20260201 09:00:10.957370 21385 heartbeater.cc:507] Master 127.18.45.62:42337 requested a full tablet report, sending...
I20260201 09:00:10.959021 21250 ts_manager.cc:194] Registered new tserver with Master: b4a7837640564db8897250c626b1441c (127.18.45.1:45051)
I20260201 09:00:10.959093 18612 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.0037009s
I20260201 09:00:10.960523 21250 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39248
I20260201 09:00:10.984875 21350 tablet_service.cc:1505] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260201 09:00:10.986047 21350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 09:00:10.996264 21395 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c: Bootstrap starting.
I20260201 09:00:10.999935 21395 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c: Neither blocks nor log segments found. Creating new log.
I20260201 09:00:11.003242 21395 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c: No bootstrap required, opened a new log
I20260201 09:00:11.003558 21395 ts_tablet_manager.cc:1403] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260201 09:00:11.005275 21395 raft_consensus.cc:359] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "b4a7837640564db8897250c626b1441c" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 45051 } }
I20260201 09:00:11.005642 21395 raft_consensus.cc:385] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 09:00:11.005848 21395 raft_consensus.cc:740] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a7837640564db8897250c626b1441c, State: Initialized, Role: FOLLOWER
I20260201 09:00:11.006309 21395 consensus_queue.cc:260] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "b4a7837640564db8897250c626b1441c" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 45051 } }
I20260201 09:00:11.006705 21395 raft_consensus.cc:399] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 09:00:11.006896 21395 raft_consensus.cc:493] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 09:00:11.007113 21395 raft_consensus.cc:3060] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [term 0 FOLLOWER]: Advancing to term 1
I20260201 09:00:11.010828 21395 raft_consensus.cc:515] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "b4a7837640564db8897250c626b1441c" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 45051 } }
I20260201 09:00:11.011310 21395 leader_election.cc:304] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4a7837640564db8897250c626b1441c; no voters:
I20260201 09:00:11.012334 21395 leader_election.cc:290] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 09:00:11.012598 21397 raft_consensus.cc:2804] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [term 1 FOLLOWER]: Leader election won for term 1
I20260201 09:00:11.013833 21397 raft_consensus.cc:697] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [term 1 LEADER]: Becoming Leader. State: Replica: b4a7837640564db8897250c626b1441c, State: Running, Role: LEADER
I20260201 09:00:11.014006 21385 heartbeater.cc:499] Master 127.18.45.62:42337 was elected leader, sending a full tablet report...
I20260201 09:00:11.014468 21395 ts_tablet_manager.cc:1434] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c: Time spent starting tablet: real 0.011s user 0.005s sys 0.006s
I20260201 09:00:11.014549 21397 consensus_queue.cc:237] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "b4a7837640564db8897250c626b1441c" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 45051 } }
I20260201 09:00:11.018818 21398 tablet_replica.cc:442] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b4a7837640564db8897250c626b1441c" committed_config { opid_index: -1 peers { permanent_uuid: "b4a7837640564db8897250c626b1441c" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 45051 } } }
I20260201 09:00:11.018923 21399 tablet_replica.cc:442] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c: TxnStatusTablet state changed. Reason: New leader b4a7837640564db8897250c626b1441c. Latest consensus state: current_term: 1 leader_uuid: "b4a7837640564db8897250c626b1441c" committed_config { opid_index: -1 peers { permanent_uuid: "b4a7837640564db8897250c626b1441c" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 45051 } } }
I20260201 09:00:11.019322 21398 tablet_replica.cc:445] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c: This TxnStatusTablet replica's current role is: LEADER
I20260201 09:00:11.019397 21399 tablet_replica.cc:445] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c: This TxnStatusTablet replica's current role is: LEADER
W20260201 09:00:11.021620 21250 catalog_manager.cc:5487] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260201 09:00:11.025871 21402 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260201 09:00:11.026306 21402 txn_status_manager.cc:930] Loading transaction status metadata into memory...
W20260201 09:00:11.027958 21250 catalog_manager.cc:5487] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260201 09:00:11.056919 18612 tablet_server.cc:178] TabletServer@127.18.45.1:0 shutting down...
I20260201 09:00:11.075929 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 09:00:11.076661 18612 tablet_replica.cc:333] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c: stopping tablet replica
I20260201 09:00:11.077142 18612 raft_consensus.cc:2243] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [term 1 LEADER]: Raft consensus shutting down.
I20260201 09:00:11.077557 18612 raft_consensus.cc:2272] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:11.097872 18612 tablet_server.cc:195] TabletServer@127.18.45.1:0 shutdown complete.
I20260201 09:00:11.107856 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 09:00:11.113126 21405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:11.114626 21406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:11.117199 21408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:11.117421 18612 server_base.cc:1060] running on GCE node
I20260201 09:00:11.118299 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 09:00:11.118469 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 09:00:11.118659 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936411118622 us; error 0 us; skew 500 ppm
I20260201 09:00:11.119153 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 09:00:11.121484 18612 webserver.cc:492] Webserver started at http://127.18.45.1:34243/ using document root <none> and password file <none>
I20260201 09:00:11.121973 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 09:00:11.122134 18612 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260201 09:00:11.125345 18612 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260201 09:00:11.127866 21413 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:11.128682 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260201 09:00:11.128994 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/ts-0-root
uuid: "b4a7837640564db8897250c626b1441c"
format_stamp: "Formatted at 2026-02-01 09:00:10 on dist-test-slave-zz6f"
I20260201 09:00:11.129266 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 09:00:11.147370 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 09:00:11.148166 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 09:00:11.155613 21422 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260201 09:00:11.162411 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260201 09:00:11.162675 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.008s user 0.001s sys 0.001s
I20260201 09:00:11.162945 18612 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260201 09:00:11.169629 18612 ts_tablet_manager.cc:616] Registered 1 tablets
I20260201 09:00:11.169862 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.007s user 0.007s sys 0.000s
I20260201 09:00:11.169983 21422 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c: Bootstrap starting.
I20260201 09:00:11.209084 21422 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 09:00:11.209985 21422 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c: Bootstrap complete.
I20260201 09:00:11.210597 21422 ts_tablet_manager.cc:1403] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c: Time spent bootstrapping tablet: real 0.041s user 0.027s sys 0.011s
I20260201 09:00:11.212935 21422 raft_consensus.cc:359] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "b4a7837640564db8897250c626b1441c" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 45051 } }
I20260201 09:00:11.213539 21422 raft_consensus.cc:740] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a7837640564db8897250c626b1441c, State: Initialized, Role: FOLLOWER
I20260201 09:00:11.214200 21422 consensus_queue.cc:260] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "b4a7837640564db8897250c626b1441c" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 45051 } }
I20260201 09:00:11.214816 21422 raft_consensus.cc:399] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 09:00:11.215121 21422 raft_consensus.cc:493] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 09:00:11.215452 21422 raft_consensus.cc:3060] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [term 1 FOLLOWER]: Advancing to term 2
I20260201 09:00:11.223433 21422 raft_consensus.cc:515] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "b4a7837640564db8897250c626b1441c" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 45051 } }
I20260201 09:00:11.224001 21422 leader_election.cc:304] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4a7837640564db8897250c626b1441c; no voters:
I20260201 09:00:11.225987 21422 leader_election.cc:290] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260201 09:00:11.226449 21450 raft_consensus.cc:2804] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [term 2 FOLLOWER]: Leader election won for term 2
I20260201 09:00:11.230191 21450 raft_consensus.cc:697] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [term 2 LEADER]: Becoming Leader. State: Replica: b4a7837640564db8897250c626b1441c, State: Running, Role: LEADER
I20260201 09:00:11.231191 21450 consensus_queue.cc:237] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "b4a7837640564db8897250c626b1441c" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 45051 } }
I20260201 09:00:11.236310 21422 ts_tablet_manager.cc:1434] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c: Time spent starting tablet: real 0.025s user 0.013s sys 0.012s
I20260201 09:00:11.243095 21453 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b4a7837640564db8897250c626b1441c" committed_config { opid_index: -1 peers { permanent_uuid: "b4a7837640564db8897250c626b1441c" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 45051 } } }
I20260201 09:00:11.243552 21453 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260201 09:00:11.244381 21452 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader b4a7837640564db8897250c626b1441c. Latest consensus state: current_term: 2 leader_uuid: "b4a7837640564db8897250c626b1441c" committed_config { opid_index: -1 peers { permanent_uuid: "b4a7837640564db8897250c626b1441c" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 45051 } } }
I20260201 09:00:11.244987 21452 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260201 09:00:11.246163 21458 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260201 09:00:11.246587 21458 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260201 09:00:11.280827 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.1:45051
I20260201 09:00:11.280920 21491 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.1:45051 every 8 connection(s)
I20260201 09:00:11.287884 18612 tablet_server.cc:178] TabletServer@127.18.45.1:45051 shutting down...
I20260201 09:00:11.287171 21492 heartbeater.cc:344] Connected to a master server at 127.18.45.62:42337
I20260201 09:00:11.288956 21492 heartbeater.cc:461] Registering TS with master...
I20260201 09:00:11.295818 21492 heartbeater.cc:507] Master 127.18.45.62:42337 requested a full tablet report, sending...
I20260201 09:00:11.302105 21250 ts_manager.cc:194] Re-registered known tserver with Master: b4a7837640564db8897250c626b1441c (127.18.45.1:45051)
W20260201 09:00:11.302662 21250 catalog_manager.cc:5487] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260201 09:00:11.304592 21250 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39272
I20260201 09:00:11.307430 21492 heartbeater.cc:499] Master 127.18.45.62:42337 was elected leader, sending a full tablet report...
W20260201 09:00:11.310568 21250 catalog_manager.cc:5487] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260201 09:00:11.327725 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 09:00:11.328799 18612 tablet_replica.cc:333] stopping tablet replica
I20260201 09:00:11.329316 18612 raft_consensus.cc:2243] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [term 2 LEADER]: Raft consensus shutting down.
I20260201 09:00:11.329752 18612 raft_consensus.cc:2272] T 11111111111111111111111111111111 P b4a7837640564db8897250c626b1441c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:11.340363 18612 tablet_server.cc:195] TabletServer@127.18.45.1:45051 shutdown complete.
I20260201 09:00:11.354363 18612 master.cc:561] Master@127.18.45.62:42337 shutting down...
I20260201 09:00:11.369199 18612 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e [term 1 LEADER]: Raft consensus shutting down.
I20260201 09:00:11.369755 18612 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:11.370116 18612 tablet_replica.cc:333] T 00000000000000000000000000000000 P 79ce5158fc0f401695f33bc91f49b63e: stopping tablet replica
I20260201 09:00:11.388723 18612 master.cc:583] Master@127.18.45.62:42337 shutdown complete.
[ OK ] TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet (721 ms)
[ RUN ] TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet
I20260201 09:00:11.423547 18612 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.45.62:38749
I20260201 09:00:11.424789 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 09:00:11.430140 21498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:11.430943 21499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:11.433626 21501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:11.433698 18612 server_base.cc:1060] running on GCE node
I20260201 09:00:11.434564 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 09:00:11.434727 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 09:00:11.434906 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936411434878 us; error 0 us; skew 500 ppm
I20260201 09:00:11.435381 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 09:00:11.437951 18612 webserver.cc:492] Webserver started at http://127.18.45.62:34269/ using document root <none> and password file <none>
I20260201 09:00:11.438419 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 09:00:11.438593 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 09:00:11.438839 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 09:00:11.439817 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/master-0-root/instance:
uuid: "eb7f7cad321c4b458f5211db27a137c3"
format_stamp: "Formatted at 2026-02-01 09:00:11 on dist-test-slave-zz6f"
I20260201 09:00:11.444003 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260201 09:00:11.447257 21506 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:11.448076 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260201 09:00:11.448341 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/master-0-root
uuid: "eb7f7cad321c4b458f5211db27a137c3"
format_stamp: "Formatted at 2026-02-01 09:00:11 on dist-test-slave-zz6f"
I20260201 09:00:11.448590 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 09:00:11.472455 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 09:00:11.473359 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 09:00:11.520574 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.62:38749
I20260201 09:00:11.520663 21557 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.62:38749 every 8 connection(s)
I20260201 09:00:11.524633 21558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 09:00:11.538431 21558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3: Bootstrap starting.
I20260201 09:00:11.544229 21558 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3: Neither blocks nor log segments found. Creating new log.
I20260201 09:00:11.548267 21558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3: No bootstrap required, opened a new log
I20260201 09:00:11.550505 21558 raft_consensus.cc:359] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb7f7cad321c4b458f5211db27a137c3" member_type: VOTER }
I20260201 09:00:11.550933 21558 raft_consensus.cc:385] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 09:00:11.551179 21558 raft_consensus.cc:740] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb7f7cad321c4b458f5211db27a137c3, State: Initialized, Role: FOLLOWER
I20260201 09:00:11.551738 21558 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb7f7cad321c4b458f5211db27a137c3" member_type: VOTER }
I20260201 09:00:11.552285 21558 raft_consensus.cc:399] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 09:00:11.552587 21558 raft_consensus.cc:493] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 09:00:11.552917 21558 raft_consensus.cc:3060] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 09:00:11.558523 21558 raft_consensus.cc:515] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb7f7cad321c4b458f5211db27a137c3" member_type: VOTER }
I20260201 09:00:11.559116 21558 leader_election.cc:304] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb7f7cad321c4b458f5211db27a137c3; no voters:
I20260201 09:00:11.560261 21558 leader_election.cc:290] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 09:00:11.560510 21561 raft_consensus.cc:2804] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 09:00:11.562338 21561 raft_consensus.cc:697] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3 [term 1 LEADER]: Becoming Leader. State: Replica: eb7f7cad321c4b458f5211db27a137c3, State: Running, Role: LEADER
I20260201 09:00:11.562912 21561 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb7f7cad321c4b458f5211db27a137c3" member_type: VOTER }
I20260201 09:00:11.563328 21558 sys_catalog.cc:565] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260201 09:00:11.566538 21562 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb7f7cad321c4b458f5211db27a137c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb7f7cad321c4b458f5211db27a137c3" member_type: VOTER } }
I20260201 09:00:11.566571 21563 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb7f7cad321c4b458f5211db27a137c3. Latest consensus state: current_term: 1 leader_uuid: "eb7f7cad321c4b458f5211db27a137c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb7f7cad321c4b458f5211db27a137c3" member_type: VOTER } }
I20260201 09:00:11.567198 21562 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3 [sys.catalog]: This master's current role is: LEADER
I20260201 09:00:11.567296 21563 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3 [sys.catalog]: This master's current role is: LEADER
I20260201 09:00:11.581132 21566 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 09:00:11.586053 21566 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 09:00:11.601975 21566 catalog_manager.cc:1357] Generated new cluster ID: 146104adbd8742798f7ea648d2fadf4f
I20260201 09:00:11.602200 21566 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 09:00:11.603957 18612 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260201 09:00:11.634308 21566 catalog_manager.cc:1380] Generated new certificate authority record
I20260201 09:00:11.635311 21566 catalog_manager.cc:1514] Loading token signing keys...
I20260201 09:00:11.645140 21566 catalog_manager.cc:6027] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3: Generated new TSK 0
I20260201 09:00:11.645625 21566 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 09:00:11.670045 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 09:00:11.676990 21579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:11.679430 21580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:11.682523 21582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:11.682581 18612 server_base.cc:1060] running on GCE node
I20260201 09:00:11.683811 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 09:00:11.684067 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 09:00:11.684237 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936411684221 us; error 0 us; skew 500 ppm
I20260201 09:00:11.684880 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 09:00:11.687183 18612 webserver.cc:492] Webserver started at http://127.18.45.1:32879/ using document root <none> and password file <none>
I20260201 09:00:11.687768 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 09:00:11.687989 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 09:00:11.688310 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 09:00:11.689644 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/ts-0-root/instance:
uuid: "82ae824be4df4bafa70111890339b887"
format_stamp: "Formatted at 2026-02-01 09:00:11 on dist-test-slave-zz6f"
I20260201 09:00:11.694808 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260201 09:00:11.701620 21587 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:11.703239 18612 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260201 09:00:11.703604 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/ts-0-root
uuid: "82ae824be4df4bafa70111890339b887"
format_stamp: "Formatted at 2026-02-01 09:00:11 on dist-test-slave-zz6f"
I20260201 09:00:11.703871 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 09:00:11.728178 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 09:00:11.729142 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 09:00:11.747226 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 09:00:11.747519 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:11.747817 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 09:00:11.748018 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:11.809901 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.1:33589
I20260201 09:00:11.809993 21657 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.1:33589 every 8 connection(s)
I20260201 09:00:11.814188 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260201 09:00:11.814225 21658 heartbeater.cc:344] Connected to a master server at 127.18.45.62:38749
I20260201 09:00:11.814667 21658 heartbeater.cc:461] Registering TS with master...
I20260201 09:00:11.815366 21658 heartbeater.cc:507] Master 127.18.45.62:38749 requested a full tablet report, sending...
I20260201 09:00:11.817358 21523 ts_manager.cc:194] Registered new tserver with Master: 82ae824be4df4bafa70111890339b887 (127.18.45.1:33589)
I20260201 09:00:11.819888 21523 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48814
W20260201 09:00:11.820087 21660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:11.821208 21661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:11.825327 21663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:11.830422 18612 server_base.cc:1060] running on GCE node
I20260201 09:00:11.831115 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 09:00:11.831313 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 09:00:11.831472 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936411831447 us; error 0 us; skew 500 ppm
I20260201 09:00:11.831914 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 09:00:11.834137 18612 webserver.cc:492] Webserver started at http://127.18.45.2:33505/ using document root <none> and password file <none>
I20260201 09:00:11.834581 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 09:00:11.834764 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 09:00:11.835009 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 09:00:11.835932 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/ts-1-root/instance:
uuid: "f423804bf52c445f80214a7d2929f123"
format_stamp: "Formatted at 2026-02-01 09:00:11 on dist-test-slave-zz6f"
I20260201 09:00:11.839963 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260201 09:00:11.842911 21668 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:11.843601 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260201 09:00:11.843905 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/ts-1-root
uuid: "f423804bf52c445f80214a7d2929f123"
format_stamp: "Formatted at 2026-02-01 09:00:11 on dist-test-slave-zz6f"
I20260201 09:00:11.844252 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 09:00:11.865927 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 09:00:11.867004 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 09:00:11.872924 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 09:00:11.873168 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:11.873418 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 09:00:11.873602 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:11.930496 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.2:36745
I20260201 09:00:11.930548 21737 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.2:36745 every 8 connection(s)
I20260201 09:00:11.935735 21738 heartbeater.cc:344] Connected to a master server at 127.18.45.62:38749
I20260201 09:00:11.936051 21738 heartbeater.cc:461] Registering TS with master...
I20260201 09:00:11.936653 21738 heartbeater.cc:507] Master 127.18.45.62:38749 requested a full tablet report, sending...
I20260201 09:00:11.938269 21523 ts_manager.cc:194] Registered new tserver with Master: f423804bf52c445f80214a7d2929f123 (127.18.45.2:36745)
I20260201 09:00:11.939391 18612 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.004965438s
I20260201 09:00:11.939564 21523 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48828
I20260201 09:00:11.970490 21623 tablet_service.cc:1505] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260201 09:00:11.971539 21623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 09:00:11.981915 21748 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887: Bootstrap starting.
I20260201 09:00:11.986050 21748 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887: Neither blocks nor log segments found. Creating new log.
I20260201 09:00:11.989631 21748 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887: No bootstrap required, opened a new log
I20260201 09:00:11.989995 21748 ts_tablet_manager.cc:1403] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.004s
I20260201 09:00:11.991772 21748 raft_consensus.cc:359] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "82ae824be4df4bafa70111890339b887" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 33589 } }
I20260201 09:00:11.992169 21748 raft_consensus.cc:385] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 09:00:11.992396 21748 raft_consensus.cc:740] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82ae824be4df4bafa70111890339b887, State: Initialized, Role: FOLLOWER
I20260201 09:00:11.992962 21748 consensus_queue.cc:260] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "82ae824be4df4bafa70111890339b887" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 33589 } }
I20260201 09:00:11.993413 21748 raft_consensus.cc:399] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 09:00:11.993655 21748 raft_consensus.cc:493] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 09:00:11.993891 21748 raft_consensus.cc:3060] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [term 0 FOLLOWER]: Advancing to term 1
I20260201 09:00:11.997761 21748 raft_consensus.cc:515] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "82ae824be4df4bafa70111890339b887" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 33589 } }
I20260201 09:00:11.998210 21748 leader_election.cc:304] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82ae824be4df4bafa70111890339b887; no voters:
I20260201 09:00:11.999418 21748 leader_election.cc:290] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 09:00:11.999701 21750 raft_consensus.cc:2804] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 09:00:12.001099 21658 heartbeater.cc:499] Master 127.18.45.62:38749 was elected leader, sending a full tablet report...
I20260201 09:00:12.002034 21748 ts_tablet_manager.cc:1434] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260201 09:00:12.002151 21750 raft_consensus.cc:697] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [term 1 LEADER]: Becoming Leader. State: Replica: 82ae824be4df4bafa70111890339b887, State: Running, Role: LEADER
I20260201 09:00:12.002831 21750 consensus_queue.cc:237] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "82ae824be4df4bafa70111890339b887" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 33589 } }
I20260201 09:00:12.006192 21752 tablet_replica.cc:442] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887: TxnStatusTablet state changed. Reason: New leader 82ae824be4df4bafa70111890339b887. Latest consensus state: current_term: 1 leader_uuid: "82ae824be4df4bafa70111890339b887" committed_config { opid_index: -1 peers { permanent_uuid: "82ae824be4df4bafa70111890339b887" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 33589 } } }
I20260201 09:00:12.006654 21752 tablet_replica.cc:445] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887: This TxnStatusTablet replica's current role is: LEADER
I20260201 09:00:12.007872 21751 tablet_replica.cc:442] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "82ae824be4df4bafa70111890339b887" committed_config { opid_index: -1 peers { permanent_uuid: "82ae824be4df4bafa70111890339b887" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 33589 } } }
I20260201 09:00:12.008334 21751 tablet_replica.cc:445] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887: This TxnStatusTablet replica's current role is: LEADER
W20260201 09:00:12.008490 21523 catalog_manager.cc:5487] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260201 09:00:12.015580 21754 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260201 09:00:12.015919 21754 txn_status_manager.cc:930] Loading transaction status metadata into memory...
W20260201 09:00:12.016959 21523 catalog_manager.cc:5487] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260201 09:00:12.061419 21759 ts_tablet_manager.cc:933] T 11111111111111111111111111111111 P f423804bf52c445f80214a7d2929f123: Initiating tablet copy from peer 82ae824be4df4bafa70111890339b887 (127.18.45.1:33589)
I20260201 09:00:12.062954 21759 tablet_copy_client.cc:323] T 11111111111111111111111111111111 P f423804bf52c445f80214a7d2929f123: tablet copy: Beginning tablet copy session from remote peer at address 127.18.45.1:33589
I20260201 09:00:12.070672 21643 tablet_copy_service.cc:140] P 82ae824be4df4bafa70111890339b887: Received BeginTabletCopySession request for tablet 11111111111111111111111111111111 from peer f423804bf52c445f80214a7d2929f123 ({username='slave'} at 127.0.0.1:42818)
I20260201 09:00:12.071059 21643 tablet_copy_service.cc:161] P 82ae824be4df4bafa70111890339b887: Beginning new tablet copy session on tablet 11111111111111111111111111111111 from peer f423804bf52c445f80214a7d2929f123 at {username='slave'} at 127.0.0.1:42818: session id = f423804bf52c445f80214a7d2929f123-11111111111111111111111111111111
I20260201 09:00:12.075361 21643 tablet_copy_source_session.cc:215] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 09:00:12.077553 21759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 09:00:12.086714 21759 tablet_copy_client.cc:806] T 11111111111111111111111111111111 P f423804bf52c445f80214a7d2929f123: tablet copy: Starting download of 0 data blocks...
I20260201 09:00:12.087127 21759 tablet_copy_client.cc:670] T 11111111111111111111111111111111 P f423804bf52c445f80214a7d2929f123: tablet copy: Starting download of 1 WAL segments...
I20260201 09:00:12.090220 21759 tablet_copy_client.cc:538] T 11111111111111111111111111111111 P f423804bf52c445f80214a7d2929f123: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 09:00:12.095029 21759 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P f423804bf52c445f80214a7d2929f123: Bootstrap starting.
I20260201 09:00:12.117121 21759 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P f423804bf52c445f80214a7d2929f123: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 09:00:12.117897 21759 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P f423804bf52c445f80214a7d2929f123: Bootstrap complete.
I20260201 09:00:12.118465 21759 ts_tablet_manager.cc:1403] T 11111111111111111111111111111111 P f423804bf52c445f80214a7d2929f123: Time spent bootstrapping tablet: real 0.024s user 0.019s sys 0.004s
I20260201 09:00:12.120663 21759 raft_consensus.cc:359] T 11111111111111111111111111111111 P f423804bf52c445f80214a7d2929f123 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "82ae824be4df4bafa70111890339b887" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 33589 } }
I20260201 09:00:12.121134 21759 raft_consensus.cc:740] T 11111111111111111111111111111111 P f423804bf52c445f80214a7d2929f123 [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: f423804bf52c445f80214a7d2929f123, State: Initialized, Role: NON_PARTICIPANT
I20260201 09:00:12.121626 21759 consensus_queue.cc:260] T 11111111111111111111111111111111 P f423804bf52c445f80214a7d2929f123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "82ae824be4df4bafa70111890339b887" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 33589 } }
I20260201 09:00:12.123145 21738 heartbeater.cc:499] Master 127.18.45.62:38749 was elected leader, sending a full tablet report...
I20260201 09:00:12.123018 21762 tablet_replica.cc:442] T 11111111111111111111111111111111 P f423804bf52c445f80214a7d2929f123: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 peers { permanent_uuid: "82ae824be4df4bafa70111890339b887" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 33589 } } }
I20260201 09:00:12.123697 21759 ts_tablet_manager.cc:1434] T 11111111111111111111111111111111 P f423804bf52c445f80214a7d2929f123: Time spent starting tablet: real 0.005s user 0.006s sys 0.001s
I20260201 09:00:12.124603 21762 tablet_replica.cc:445] T 11111111111111111111111111111111 P f423804bf52c445f80214a7d2929f123: This TxnStatusTablet replica's current role is: NON_PARTICIPANT
I20260201 09:00:12.125443 21643 tablet_copy_service.cc:342] P 82ae824be4df4bafa70111890339b887: Request end of tablet copy session f423804bf52c445f80214a7d2929f123-11111111111111111111111111111111 received from {username='slave'} at 127.0.0.1:42818
I20260201 09:00:12.125800 21643 tablet_copy_service.cc:434] P 82ae824be4df4bafa70111890339b887: ending tablet copy session f423804bf52c445f80214a7d2929f123-11111111111111111111111111111111 on tablet 11111111111111111111111111111111 with peer f423804bf52c445f80214a7d2929f123
W20260201 09:00:12.125892 21523 catalog_manager.cc:5487] Ignoring report from unknown tablet 11111111111111111111111111111111
W20260201 09:00:12.129647 21523 catalog_manager.cc:5487] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260201 09:00:12.151921 18612 tablet_server.cc:178] TabletServer@127.18.45.1:0 shutting down...
I20260201 09:00:12.170197 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 09:00:12.171093 18612 tablet_replica.cc:333] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887: stopping tablet replica
I20260201 09:00:12.171891 18612 raft_consensus.cc:2243] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [term 1 LEADER]: Raft consensus shutting down.
I20260201 09:00:12.172597 18612 raft_consensus.cc:2272] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:12.188445 18612 tablet_server.cc:195] TabletServer@127.18.45.1:0 shutdown complete.
I20260201 09:00:12.199899 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 09:00:12.205251 21763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:12.205446 21764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:12.207931 21766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:12.208508 18612 server_base.cc:1060] running on GCE node
I20260201 09:00:12.209412 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 09:00:12.209596 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 09:00:12.209736 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936412209719 us; error 0 us; skew 500 ppm
I20260201 09:00:12.210188 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 09:00:12.212524 18612 webserver.cc:492] Webserver started at http://127.18.45.1:32879/ using document root <none> and password file <none>
I20260201 09:00:12.212998 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 09:00:12.213169 18612 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260201 09:00:12.216459 18612 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260201 09:00:12.219213 21771 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:12.219940 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260201 09:00:12.220361 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/ts-0-root
uuid: "82ae824be4df4bafa70111890339b887"
format_stamp: "Formatted at 2026-02-01 09:00:11 on dist-test-slave-zz6f"
I20260201 09:00:12.220839 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1769936356186478-18612-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 09:00:12.259271 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 09:00:12.260537 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 09:00:12.268165 21780 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260201 09:00:12.275149 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260201 09:00:12.275434 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.008s user 0.001s sys 0.000s
I20260201 09:00:12.275739 18612 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260201 09:00:12.281371 18612 ts_tablet_manager.cc:616] Registered 1 tablets
I20260201 09:00:12.281594 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.006s user 0.006s sys 0.000s
I20260201 09:00:12.281734 21780 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887: Bootstrap starting.
I20260201 09:00:12.315958 21780 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 09:00:12.316689 21780 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887: Bootstrap complete.
I20260201 09:00:12.317279 21780 ts_tablet_manager.cc:1403] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887: Time spent bootstrapping tablet: real 0.036s user 0.020s sys 0.011s
I20260201 09:00:12.319602 21780 raft_consensus.cc:359] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "82ae824be4df4bafa70111890339b887" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 33589 } }
I20260201 09:00:12.320165 21780 raft_consensus.cc:740] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82ae824be4df4bafa70111890339b887, State: Initialized, Role: FOLLOWER
I20260201 09:00:12.320971 21780 consensus_queue.cc:260] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "82ae824be4df4bafa70111890339b887" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 33589 } }
I20260201 09:00:12.321591 21780 raft_consensus.cc:399] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 09:00:12.321981 21780 raft_consensus.cc:493] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 09:00:12.322358 21780 raft_consensus.cc:3060] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [term 1 FOLLOWER]: Advancing to term 2
I20260201 09:00:12.328787 21780 raft_consensus.cc:515] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "82ae824be4df4bafa70111890339b887" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 33589 } }
I20260201 09:00:12.329474 21780 leader_election.cc:304] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82ae824be4df4bafa70111890339b887; no voters:
I20260201 09:00:12.353116 21780 leader_election.cc:290] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260201 09:00:12.353508 21810 raft_consensus.cc:2804] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 09:00:12.354946 21810 raft_consensus.cc:697] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [term 2 LEADER]: Becoming Leader. State: Replica: 82ae824be4df4bafa70111890339b887, State: Running, Role: LEADER
I20260201 09:00:12.355605 21810 consensus_queue.cc:237] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "82ae824be4df4bafa70111890339b887" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 33589 } }
I20260201 09:00:12.362166 21780 ts_tablet_manager.cc:1434] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887: Time spent starting tablet: real 0.045s user 0.024s sys 0.017s
I20260201 09:00:12.368104 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.1:33589
I20260201 09:00:12.368337 21846 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.1:33589 every 8 connection(s)
I20260201 09:00:12.371766 21831 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "82ae824be4df4bafa70111890339b887" committed_config { opid_index: -1 peers { permanent_uuid: "82ae824be4df4bafa70111890339b887" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 33589 } } }
I20260201 09:00:12.372435 21831 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260201 09:00:12.374069 21830 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 82ae824be4df4bafa70111890339b887. Latest consensus state: current_term: 2 leader_uuid: "82ae824be4df4bafa70111890339b887" committed_config { opid_index: -1 peers { permanent_uuid: "82ae824be4df4bafa70111890339b887" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 33589 } } }
I20260201 09:00:12.374490 21849 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260201 09:00:12.374696 21830 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260201 09:00:12.374948 21849 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260201 09:00:12.384282 21848 heartbeater.cc:344] Connected to a master server at 127.18.45.62:38749
I20260201 09:00:12.384805 21848 heartbeater.cc:461] Registering TS with master...
I20260201 09:00:12.385851 21848 heartbeater.cc:507] Master 127.18.45.62:38749 requested a full tablet report, sending...
I20260201 09:00:12.388753 21523 ts_manager.cc:194] Re-registered known tserver with Master: 82ae824be4df4bafa70111890339b887 (127.18.45.1:33589)
W20260201 09:00:12.389235 21523 catalog_manager.cc:5487] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260201 09:00:12.390344 18612 tablet_server.cc:178] TabletServer@127.18.45.1:33589 shutting down...
I20260201 09:00:12.390739 21523 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48864
I20260201 09:00:12.393124 21848 heartbeater.cc:499] Master 127.18.45.62:38749 was elected leader, sending a full tablet report...
W20260201 09:00:12.397912 21523 catalog_manager.cc:5487] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260201 09:00:12.408502 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 09:00:12.409159 18612 tablet_replica.cc:333] stopping tablet replica
I20260201 09:00:12.409631 18612 raft_consensus.cc:2243] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [term 2 LEADER]: Raft consensus shutting down.
I20260201 09:00:12.410043 18612 raft_consensus.cc:2272] T 11111111111111111111111111111111 P 82ae824be4df4bafa70111890339b887 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:12.430115 18612 tablet_server.cc:195] TabletServer@127.18.45.1:33589 shutdown complete.
I20260201 09:00:12.439730 18612 tablet_server.cc:178] TabletServer@127.18.45.2:0 shutting down...
I20260201 09:00:12.460395 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 09:00:12.461194 18612 tablet_replica.cc:333] T 11111111111111111111111111111111 P f423804bf52c445f80214a7d2929f123: stopping tablet replica
I20260201 09:00:12.461683 18612 raft_consensus.cc:2243] T 11111111111111111111111111111111 P f423804bf52c445f80214a7d2929f123 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260201 09:00:12.462033 18612 raft_consensus.cc:2272] T 11111111111111111111111111111111 P f423804bf52c445f80214a7d2929f123 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260201 09:00:12.480271 18612 tablet_server.cc:195] TabletServer@127.18.45.2:0 shutdown complete.
I20260201 09:00:12.489761 18612 master.cc:561] Master@127.18.45.62:38749 shutting down...
I20260201 09:00:12.505924 18612 raft_consensus.cc:2243] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3 [term 1 LEADER]: Raft consensus shutting down.
I20260201 09:00:12.506357 18612 raft_consensus.cc:2272] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:12.506633 18612 tablet_replica.cc:333] T 00000000000000000000000000000000 P eb7f7cad321c4b458f5211db27a137c3: stopping tablet replica
I20260201 09:00:12.524869 18612 master.cc:583] Master@127.18.45.62:38749 shutdown complete.
[ OK ] TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet (1131 ms)
[ RUN ] TxnStatusTabletManagementTest.TestTabletServerProxyCalls
I20260201 09:00:12.555075 18612 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.45.62:44293
I20260201 09:00:12.556298 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 09:00:12.561933 21856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:12.562830 21857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:12.566282 21859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:12.566767 18612 server_base.cc:1060] running on GCE node
I20260201 09:00:12.567509 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 09:00:12.567668 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 09:00:12.567829 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936412567806 us; error 0 us; skew 500 ppm
I20260201 09:00:12.568465 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 09:00:12.570804 18612 webserver.cc:492] Webserver started at http://127.18.45.62:34407/ using document root <none> and password file <none>
I20260201 09:00:12.571278 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 09:00:12.571466 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 09:00:12.571714 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 09:00:12.572693 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1769936356186478-18612-0/minicluster-data/master-0-root/instance:
uuid: "9f6c1d07f5624f49a9f966d5f1489767"
format_stamp: "Formatted at 2026-02-01 09:00:12 on dist-test-slave-zz6f"
I20260201 09:00:12.576891 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260201 09:00:12.580096 21864 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:12.580790 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260201 09:00:12.581075 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1769936356186478-18612-0/minicluster-data/master-0-root
uuid: "9f6c1d07f5624f49a9f966d5f1489767"
format_stamp: "Formatted at 2026-02-01 09:00:12 on dist-test-slave-zz6f"
I20260201 09:00:12.581326 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1769936356186478-18612-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1769936356186478-18612-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1769936356186478-18612-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 09:00:12.602175 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 09:00:12.603084 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 09:00:12.644065 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.62:44293
I20260201 09:00:12.644204 21915 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.62:44293 every 8 connection(s)
I20260201 09:00:12.647959 21916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 09:00:12.656730 21916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767: Bootstrap starting.
I20260201 09:00:12.660691 21916 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767: Neither blocks nor log segments found. Creating new log.
I20260201 09:00:12.664227 21916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767: No bootstrap required, opened a new log
I20260201 09:00:12.666009 21916 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f6c1d07f5624f49a9f966d5f1489767" member_type: VOTER }
I20260201 09:00:12.666356 21916 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 09:00:12.666558 21916 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f6c1d07f5624f49a9f966d5f1489767, State: Initialized, Role: FOLLOWER
I20260201 09:00:12.667001 21916 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f6c1d07f5624f49a9f966d5f1489767" member_type: VOTER }
I20260201 09:00:12.667393 21916 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 09:00:12.667598 21916 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 09:00:12.667821 21916 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767 [term 0 FOLLOWER]: Advancing to term 1
I20260201 09:00:12.671442 21916 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f6c1d07f5624f49a9f966d5f1489767" member_type: VOTER }
I20260201 09:00:12.671871 21916 leader_election.cc:304] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f6c1d07f5624f49a9f966d5f1489767; no voters:
I20260201 09:00:12.673008 21916 leader_election.cc:290] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 09:00:12.673293 21919 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 09:00:12.674993 21919 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767 [term 1 LEADER]: Becoming Leader. State: Replica: 9f6c1d07f5624f49a9f966d5f1489767, State: Running, Role: LEADER
I20260201 09:00:12.675693 21919 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f6c1d07f5624f49a9f966d5f1489767" member_type: VOTER }
I20260201 09:00:12.676538 21916 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767 [sys.catalog]: configured and running, proceeding with master startup.
I20260201 09:00:12.678534 21921 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f6c1d07f5624f49a9f966d5f1489767. Latest consensus state: current_term: 1 leader_uuid: "9f6c1d07f5624f49a9f966d5f1489767" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f6c1d07f5624f49a9f966d5f1489767" member_type: VOTER } }
I20260201 09:00:12.679061 21921 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767 [sys.catalog]: This master's current role is: LEADER
I20260201 09:00:12.680251 21920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9f6c1d07f5624f49a9f966d5f1489767" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f6c1d07f5624f49a9f966d5f1489767" member_type: VOTER } }
I20260201 09:00:12.680843 21920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767 [sys.catalog]: This master's current role is: LEADER
I20260201 09:00:12.687101 21924 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 09:00:12.693493 21924 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 09:00:12.694550 18612 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260201 09:00:12.702488 21924 catalog_manager.cc:1357] Generated new cluster ID: a3ff5df5800d48c9a6b6dc5cb635aaf9
I20260201 09:00:12.702710 21924 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 09:00:12.735002 21924 catalog_manager.cc:1380] Generated new certificate authority record
I20260201 09:00:12.736066 21924 catalog_manager.cc:1514] Loading token signing keys...
I20260201 09:00:12.747301 21924 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767: Generated new TSK 0
I20260201 09:00:12.747736 21924 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 09:00:12.760727 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 09:00:12.767287 21937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:12.768254 21938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:12.769903 21940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:12.770421 18612 server_base.cc:1060] running on GCE node
I20260201 09:00:12.771328 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 09:00:12.771582 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 09:00:12.771767 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936412771753 us; error 0 us; skew 500 ppm
I20260201 09:00:12.772413 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 09:00:12.774884 18612 webserver.cc:492] Webserver started at http://127.18.45.1:34235/ using document root <none> and password file <none>
I20260201 09:00:12.775419 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 09:00:12.775637 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 09:00:12.775915 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 09:00:12.777249 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1769936356186478-18612-0/minicluster-data/ts-0-root/instance:
uuid: "d55295980239469e8b543515d9129600"
format_stamp: "Formatted at 2026-02-01 09:00:12 on dist-test-slave-zz6f"
I20260201 09:00:12.782488 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260201 09:00:12.786375 21945 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:12.787153 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260201 09:00:12.787505 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1769936356186478-18612-0/minicluster-data/ts-0-root
uuid: "d55295980239469e8b543515d9129600"
format_stamp: "Formatted at 2026-02-01 09:00:12 on dist-test-slave-zz6f"
I20260201 09:00:12.787830 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1769936356186478-18612-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1769936356186478-18612-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1769936356186478-18612-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 09:00:12.799362 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 09:00:12.800529 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 09:00:12.811923 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 09:00:12.812166 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:12.812409 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 09:00:12.812599 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:12.876158 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.1:43601
I20260201 09:00:12.876217 22015 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.1:43601 every 8 connection(s)
I20260201 09:00:12.881496 22016 heartbeater.cc:344] Connected to a master server at 127.18.45.62:44293
I20260201 09:00:12.881909 22016 heartbeater.cc:461] Registering TS with master...
I20260201 09:00:12.882654 22016 heartbeater.cc:507] Master 127.18.45.62:44293 requested a full tablet report, sending...
I20260201 09:00:12.884456 21881 ts_manager.cc:194] Registered new tserver with Master: d55295980239469e8b543515d9129600 (127.18.45.1:43601)
I20260201 09:00:12.885288 18612 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004768131s
I20260201 09:00:12.886547 21881 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53962
I20260201 09:00:12.916074 21981 tablet_service.cc:1505] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260201 09:00:12.917490 21981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 09:00:12.932363 22026 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600: Bootstrap starting.
I20260201 09:00:12.936331 22026 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600: Neither blocks nor log segments found. Creating new log.
I20260201 09:00:12.940117 22026 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600: No bootstrap required, opened a new log
I20260201 09:00:12.940460 22026 ts_tablet_manager.cc:1403] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.004s
I20260201 09:00:12.942267 22026 raft_consensus.cc:359] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "d55295980239469e8b543515d9129600" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 43601 } }
I20260201 09:00:12.942642 22026 raft_consensus.cc:385] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 09:00:12.942862 22026 raft_consensus.cc:740] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55295980239469e8b543515d9129600, State: Initialized, Role: FOLLOWER
I20260201 09:00:12.943486 22026 consensus_queue.cc:260] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "d55295980239469e8b543515d9129600" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 43601 } }
I20260201 09:00:12.943967 22026 raft_consensus.cc:399] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 09:00:12.944252 22026 raft_consensus.cc:493] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 09:00:12.944543 22026 raft_consensus.cc:3060] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600 [term 0 FOLLOWER]: Advancing to term 1
I20260201 09:00:12.948957 22026 raft_consensus.cc:515] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "d55295980239469e8b543515d9129600" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 43601 } }
I20260201 09:00:12.949404 22026 leader_election.cc:304] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d55295980239469e8b543515d9129600; no voters:
I20260201 09:00:12.950722 22026 leader_election.cc:290] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 09:00:12.951002 22028 raft_consensus.cc:2804] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 09:00:12.952525 22016 heartbeater.cc:499] Master 127.18.45.62:44293 was elected leader, sending a full tablet report...
I20260201 09:00:12.953493 22026 ts_tablet_manager.cc:1434] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600: Time spent starting tablet: real 0.013s user 0.008s sys 0.005s
I20260201 09:00:12.953629 22028 raft_consensus.cc:697] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600 [term 1 LEADER]: Becoming Leader. State: Replica: d55295980239469e8b543515d9129600, State: Running, Role: LEADER
I20260201 09:00:12.954305 22028 consensus_queue.cc:237] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "d55295980239469e8b543515d9129600" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 43601 } }
I20260201 09:00:12.957372 22029 tablet_replica.cc:442] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d55295980239469e8b543515d9129600" committed_config { opid_index: -1 peers { permanent_uuid: "d55295980239469e8b543515d9129600" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 43601 } } }
I20260201 09:00:12.957819 22029 tablet_replica.cc:445] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600: This TxnStatusTablet replica's current role is: LEADER
W20260201 09:00:12.959875 21881 catalog_manager.cc:5487] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260201 09:00:12.962817 22030 tablet_replica.cc:442] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600: TxnStatusTablet state changed. Reason: New leader d55295980239469e8b543515d9129600. Latest consensus state: current_term: 1 leader_uuid: "d55295980239469e8b543515d9129600" committed_config { opid_index: -1 peers { permanent_uuid: "d55295980239469e8b543515d9129600" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 43601 } } }
I20260201 09:00:12.963366 22030 tablet_replica.cc:445] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600: This TxnStatusTablet replica's current role is: LEADER
I20260201 09:00:12.965095 22032 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260201 09:00:12.965431 22032 txn_status_manager.cc:930] Loading transaction status metadata into memory...
W20260201 09:00:12.966787 21881 catalog_manager.cc:5487] Ignoring report from unknown tablet 11111111111111111111111111111111
W20260201 09:00:13.011425 21963 meta_cache.cc:788] Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20260201 09:00:13.011726 21963 txn_status_manager.cc:244] Participant participant of txn 1 returned error for BEGIN_COMMIT op, aborting: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20260201 09:00:13.012037 21963 txn_status_manager.cc:206] Scheduling write for ABORT_IN_PROGRESS for txn 1
I20260201 09:00:13.018823 21963 txn_status_manager.cc:337] Participant participant was not found for ABORT_TXN, proceeding as if op succeeded: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20260201 09:00:13.050722 21963 txn_status_manager.cc:244] Participant participant of txn 2 returned error for BEGIN_COMMIT op, aborting: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20260201 09:00:13.051011 21963 txn_status_manager.cc:206] Scheduling write for ABORT_IN_PROGRESS for txn 2
I20260201 09:00:13.057526 21963 txn_status_manager.cc:337] Participant participant was not found for ABORT_TXN, proceeding as if op succeeded: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
W20260201 09:00:13.067490 21981 server_base.cc:1142] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:45788
W20260201 09:00:13.069406 21981 server_base.cc:1142] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:45788
W20260201 09:00:13.070968 21981 server_base.cc:1142] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:45788
W20260201 09:00:13.072577 21981 server_base.cc:1142] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:45788
W20260201 09:00:13.074230 21981 server_base.cc:1142] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:45788
W20260201 09:00:13.075989 21981 server_base.cc:1142] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:45788
W20260201 09:00:13.085013 21981 server_base.cc:1142] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:45800
W20260201 09:00:13.086722 21981 server_base.cc:1142] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:45800
W20260201 09:00:13.088371 21981 server_base.cc:1142] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:45800
W20260201 09:00:13.090142 21981 server_base.cc:1142] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:45800
W20260201 09:00:13.091710 21981 server_base.cc:1142] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:45800
W20260201 09:00:13.093365 21981 server_base.cc:1142] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:45800
I20260201 09:00:13.095623 18612 tablet_server.cc:178] TabletServer@127.18.45.1:0 shutting down...
I20260201 09:00:13.118989 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 09:00:13.119942 18612 tablet_replica.cc:333] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600: stopping tablet replica
I20260201 09:00:13.120399 18612 raft_consensus.cc:2243] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600 [term 1 LEADER]: Raft consensus shutting down.
I20260201 09:00:13.120873 18612 raft_consensus.cc:2272] T 11111111111111111111111111111111 P d55295980239469e8b543515d9129600 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:13.141188 18612 tablet_server.cc:195] TabletServer@127.18.45.1:0 shutdown complete.
I20260201 09:00:13.151351 18612 master.cc:561] Master@127.18.45.62:44293 shutting down...
I20260201 09:00:13.169183 18612 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767 [term 1 LEADER]: Raft consensus shutting down.
I20260201 09:00:13.169713 18612 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:13.170133 18612 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9f6c1d07f5624f49a9f966d5f1489767: stopping tablet replica
I20260201 09:00:13.179286 18612 master.cc:583] Master@127.18.45.62:44293 shutdown complete.
[ OK ] TxnStatusTabletManagementTest.TestTabletServerProxyCalls (649 ms)
[ RUN ] TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors
I20260201 09:00:13.204774 18612 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.45.62:34563
I20260201 09:00:13.205811 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 09:00:13.210656 22041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:13.210914 22042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:13.213292 22044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:13.214610 18612 server_base.cc:1060] running on GCE node
I20260201 09:00:13.215436 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 09:00:13.215641 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 09:00:13.215812 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936413215784 us; error 0 us; skew 500 ppm
I20260201 09:00:13.216306 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 09:00:13.218976 18612 webserver.cc:492] Webserver started at http://127.18.45.62:38393/ using document root <none> and password file <none>
I20260201 09:00:13.219429 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 09:00:13.219621 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 09:00:13.219868 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 09:00:13.220894 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1769936356186478-18612-0/minicluster-data/master-0-root/instance:
uuid: "4fe6bf1adcc740ec931b43ae8e248509"
format_stamp: "Formatted at 2026-02-01 09:00:13 on dist-test-slave-zz6f"
I20260201 09:00:13.224947 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260201 09:00:13.228238 22049 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:13.229116 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260201 09:00:13.229501 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1769936356186478-18612-0/minicluster-data/master-0-root
uuid: "4fe6bf1adcc740ec931b43ae8e248509"
format_stamp: "Formatted at 2026-02-01 09:00:13 on dist-test-slave-zz6f"
I20260201 09:00:13.230028 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1769936356186478-18612-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1769936356186478-18612-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1769936356186478-18612-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 09:00:13.242280 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 09:00:13.243134 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 09:00:13.294260 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.62:34563
I20260201 09:00:13.294346 22100 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.62:34563 every 8 connection(s)
I20260201 09:00:13.298056 22101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 09:00:13.307096 22101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509: Bootstrap starting.
I20260201 09:00:13.311134 22101 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509: Neither blocks nor log segments found. Creating new log.
I20260201 09:00:13.314460 22101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509: No bootstrap required, opened a new log
I20260201 09:00:13.316248 22101 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe6bf1adcc740ec931b43ae8e248509" member_type: VOTER }
I20260201 09:00:13.316602 22101 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 09:00:13.316812 22101 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fe6bf1adcc740ec931b43ae8e248509, State: Initialized, Role: FOLLOWER
I20260201 09:00:13.317353 22101 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe6bf1adcc740ec931b43ae8e248509" member_type: VOTER }
I20260201 09:00:13.317782 22101 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 09:00:13.317986 22101 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 09:00:13.318204 22101 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509 [term 0 FOLLOWER]: Advancing to term 1
I20260201 09:00:13.322039 22101 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe6bf1adcc740ec931b43ae8e248509" member_type: VOTER }
I20260201 09:00:13.322491 22101 leader_election.cc:304] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4fe6bf1adcc740ec931b43ae8e248509; no voters:
I20260201 09:00:13.323431 22101 leader_election.cc:290] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 09:00:13.323702 22104 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 09:00:13.324939 22104 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509 [term 1 LEADER]: Becoming Leader. State: Replica: 4fe6bf1adcc740ec931b43ae8e248509, State: Running, Role: LEADER
I20260201 09:00:13.325549 22104 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe6bf1adcc740ec931b43ae8e248509" member_type: VOTER }
I20260201 09:00:13.326134 22101 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509 [sys.catalog]: configured and running, proceeding with master startup.
I20260201 09:00:13.328138 22106 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4fe6bf1adcc740ec931b43ae8e248509. Latest consensus state: current_term: 1 leader_uuid: "4fe6bf1adcc740ec931b43ae8e248509" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe6bf1adcc740ec931b43ae8e248509" member_type: VOTER } }
I20260201 09:00:13.328227 22105 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4fe6bf1adcc740ec931b43ae8e248509" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe6bf1adcc740ec931b43ae8e248509" member_type: VOTER } }
I20260201 09:00:13.328846 22105 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509 [sys.catalog]: This master's current role is: LEADER
I20260201 09:00:13.328841 22106 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509 [sys.catalog]: This master's current role is: LEADER
I20260201 09:00:13.337556 22109 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 09:00:13.341720 22109 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 09:00:13.345167 18612 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260201 09:00:13.349028 22109 catalog_manager.cc:1357] Generated new cluster ID: aa7a6a0731e849c6a4ae7f05c56efe71
I20260201 09:00:13.349256 22109 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 09:00:13.364636 22109 catalog_manager.cc:1380] Generated new certificate authority record
I20260201 09:00:13.365688 22109 catalog_manager.cc:1514] Loading token signing keys...
I20260201 09:00:13.377278 22109 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509: Generated new TSK 0
I20260201 09:00:13.377740 22109 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 09:00:13.410786 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 09:00:13.416635 22122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:13.417714 22123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:13.419009 18612 server_base.cc:1060] running on GCE node
W20260201 09:00:13.418977 22125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:13.419952 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 09:00:13.420120 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 09:00:13.420248 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936413420237 us; error 0 us; skew 500 ppm
I20260201 09:00:13.420706 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 09:00:13.422610 18612 webserver.cc:492] Webserver started at http://127.18.45.1:45631/ using document root <none> and password file <none>
I20260201 09:00:13.423003 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 09:00:13.423138 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 09:00:13.423334 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 09:00:13.424175 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1769936356186478-18612-0/minicluster-data/ts-0-root/instance:
uuid: "3c3f2f5f2ca24a9aaf45efcd888046f7"
format_stamp: "Formatted at 2026-02-01 09:00:13 on dist-test-slave-zz6f"
I20260201 09:00:13.428114 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260201 09:00:13.430958 22130 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:13.431605 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260201 09:00:13.431879 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1769936356186478-18612-0/minicluster-data/ts-0-root
uuid: "3c3f2f5f2ca24a9aaf45efcd888046f7"
format_stamp: "Formatted at 2026-02-01 09:00:13 on dist-test-slave-zz6f"
I20260201 09:00:13.432163 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1769936356186478-18612-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1769936356186478-18612-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1769936356186478-18612-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 09:00:13.443938 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 09:00:13.444792 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 09:00:13.448961 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 09:00:13.449225 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:13.449509 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 09:00:13.449718 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:13.499483 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.1:41201
I20260201 09:00:13.499567 22200 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.1:41201 every 8 connection(s)
I20260201 09:00:13.503443 22201 heartbeater.cc:344] Connected to a master server at 127.18.45.62:34563
I20260201 09:00:13.503767 22201 heartbeater.cc:461] Registering TS with master...
I20260201 09:00:13.504356 22201 heartbeater.cc:507] Master 127.18.45.62:34563 requested a full tablet report, sending...
I20260201 09:00:13.505990 22066 ts_manager.cc:194] Registered new tserver with Master: 3c3f2f5f2ca24a9aaf45efcd888046f7 (127.18.45.1:41201)
I20260201 09:00:13.506049 18612 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.003607414s
I20260201 09:00:13.507515 22066 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57700
I20260201 09:00:13.532534 22166 tablet_service.cc:1505] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260201 09:00:13.533495 22166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 09:00:13.543128 22211 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7: Bootstrap starting.
I20260201 09:00:13.546558 22211 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7: Neither blocks nor log segments found. Creating new log.
I20260201 09:00:13.549624 22211 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7: No bootstrap required, opened a new log
I20260201 09:00:13.549986 22211 ts_tablet_manager.cc:1403] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260201 09:00:13.551667 22211 raft_consensus.cc:359] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "3c3f2f5f2ca24a9aaf45efcd888046f7" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 41201 } }
I20260201 09:00:13.552057 22211 raft_consensus.cc:385] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 09:00:13.552289 22211 raft_consensus.cc:740] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3f2f5f2ca24a9aaf45efcd888046f7, State: Initialized, Role: FOLLOWER
I20260201 09:00:13.552728 22211 consensus_queue.cc:260] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "3c3f2f5f2ca24a9aaf45efcd888046f7" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 41201 } }
I20260201 09:00:13.553128 22211 raft_consensus.cc:399] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 09:00:13.553331 22211 raft_consensus.cc:493] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 09:00:13.553582 22211 raft_consensus.cc:3060] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [term 0 FOLLOWER]: Advancing to term 1
I20260201 09:00:13.557453 22211 raft_consensus.cc:515] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "3c3f2f5f2ca24a9aaf45efcd888046f7" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 41201 } }
I20260201 09:00:13.557914 22211 leader_election.cc:304] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c3f2f5f2ca24a9aaf45efcd888046f7; no voters:
I20260201 09:00:13.558943 22211 leader_election.cc:290] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 09:00:13.559237 22213 raft_consensus.cc:2804] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 09:00:13.560689 22201 heartbeater.cc:499] Master 127.18.45.62:34563 was elected leader, sending a full tablet report...
I20260201 09:00:13.560655 22213 raft_consensus.cc:697] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [term 1 LEADER]: Becoming Leader. State: Replica: 3c3f2f5f2ca24a9aaf45efcd888046f7, State: Running, Role: LEADER
I20260201 09:00:13.561344 22211 ts_tablet_manager.cc:1434] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260201 09:00:13.561686 22213 consensus_queue.cc:237] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "3c3f2f5f2ca24a9aaf45efcd888046f7" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 41201 } }
I20260201 09:00:13.565001 22214 tablet_replica.cc:442] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c3f2f5f2ca24a9aaf45efcd888046f7" committed_config { opid_index: -1 peers { permanent_uuid: "3c3f2f5f2ca24a9aaf45efcd888046f7" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 41201 } } }
I20260201 09:00:13.565450 22214 tablet_replica.cc:445] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7: This TxnStatusTablet replica's current role is: LEADER
I20260201 09:00:13.565423 22215 tablet_replica.cc:442] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7: TxnStatusTablet state changed. Reason: New leader 3c3f2f5f2ca24a9aaf45efcd888046f7. Latest consensus state: current_term: 1 leader_uuid: "3c3f2f5f2ca24a9aaf45efcd888046f7" committed_config { opid_index: -1 peers { permanent_uuid: "3c3f2f5f2ca24a9aaf45efcd888046f7" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 41201 } } }
I20260201 09:00:13.565976 22215 tablet_replica.cc:445] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7: This TxnStatusTablet replica's current role is: LEADER
I20260201 09:00:13.567842 22218 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
W20260201 09:00:13.568109 22066 catalog_manager.cc:5487] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260201 09:00:13.568204 22218 txn_status_manager.cc:930] Loading transaction status metadata into memory...
W20260201 09:00:13.571283 22066 catalog_manager.cc:5487] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260201 09:00:13.588500 22166 tablet_service.cc:1505] Processing CreateTablet for tablet 22222222222222222222222222222222 (table=22222222222222222222222222222222_table_name [id=22222222222222222222222222222222_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260201 09:00:13.589345 22166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22222222222222222222222222222222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 09:00:13.597851 22211 tablet_bootstrap.cc:492] T 22222222222222222222222222222222 P 3c3f2f5f2ca24a9aaf45efcd888046f7: Bootstrap starting.
I20260201 09:00:13.601641 22211 tablet_bootstrap.cc:654] T 22222222222222222222222222222222 P 3c3f2f5f2ca24a9aaf45efcd888046f7: Neither blocks nor log segments found. Creating new log.
I20260201 09:00:13.604959 22211 tablet_bootstrap.cc:492] T 22222222222222222222222222222222 P 3c3f2f5f2ca24a9aaf45efcd888046f7: No bootstrap required, opened a new log
I20260201 09:00:13.605288 22211 ts_tablet_manager.cc:1403] T 22222222222222222222222222222222 P 3c3f2f5f2ca24a9aaf45efcd888046f7: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260201 09:00:13.606986 22211 raft_consensus.cc:359] T 22222222222222222222222222222222 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "3c3f2f5f2ca24a9aaf45efcd888046f7" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 41201 } }
I20260201 09:00:13.607393 22211 raft_consensus.cc:385] T 22222222222222222222222222222222 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 09:00:13.607666 22211 raft_consensus.cc:740] T 22222222222222222222222222222222 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3f2f5f2ca24a9aaf45efcd888046f7, State: Initialized, Role: FOLLOWER
I20260201 09:00:13.608165 22211 consensus_queue.cc:260] T 22222222222222222222222222222222 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "3c3f2f5f2ca24a9aaf45efcd888046f7" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 41201 } }
I20260201 09:00:13.608621 22211 raft_consensus.cc:399] T 22222222222222222222222222222222 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 09:00:13.608853 22211 raft_consensus.cc:493] T 22222222222222222222222222222222 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 09:00:13.609118 22211 raft_consensus.cc:3060] T 22222222222222222222222222222222 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [term 0 FOLLOWER]: Advancing to term 1
I20260201 09:00:13.612704 22211 raft_consensus.cc:515] T 22222222222222222222222222222222 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "3c3f2f5f2ca24a9aaf45efcd888046f7" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 41201 } }
I20260201 09:00:13.613183 22211 leader_election.cc:304] T 22222222222222222222222222222222 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c3f2f5f2ca24a9aaf45efcd888046f7; no voters:
I20260201 09:00:13.613583 22211 leader_election.cc:290] T 22222222222222222222222222222222 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 09:00:13.613747 22213 raft_consensus.cc:2804] T 22222222222222222222222222222222 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 09:00:13.614243 22213 raft_consensus.cc:697] T 22222222222222222222222222222222 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [term 1 LEADER]: Becoming Leader. State: Replica: 3c3f2f5f2ca24a9aaf45efcd888046f7, State: Running, Role: LEADER
I20260201 09:00:13.614964 22211 ts_tablet_manager.cc:1434] T 22222222222222222222222222222222 P 3c3f2f5f2ca24a9aaf45efcd888046f7: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260201 09:00:13.614813 22213 consensus_queue.cc:237] T 22222222222222222222222222222222 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "3c3f2f5f2ca24a9aaf45efcd888046f7" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 41201 } }
W20260201 09:00:13.619537 22066 catalog_manager.cc:5487] Ignoring report from unknown tablet 22222222222222222222222222222222
W20260201 09:00:13.622743 22066 catalog_manager.cc:5487] Ignoring report from unknown tablet 22222222222222222222222222222222
I20260201 09:00:13.644294 18612 tablet_server.cc:178] TabletServer@127.18.45.1:0 shutting down...
I20260201 09:00:13.660029 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 09:00:13.660748 18612 tablet_replica.cc:333] T 22222222222222222222222222222222 P 3c3f2f5f2ca24a9aaf45efcd888046f7: stopping tablet replica
I20260201 09:00:13.661259 18612 raft_consensus.cc:2243] T 22222222222222222222222222222222 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [term 1 LEADER]: Raft consensus shutting down.
I20260201 09:00:13.661635 18612 raft_consensus.cc:2272] T 22222222222222222222222222222222 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:13.664021 18612 tablet_replica.cc:333] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7: stopping tablet replica
I20260201 09:00:13.664463 18612 raft_consensus.cc:2243] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [term 1 LEADER]: Raft consensus shutting down.
I20260201 09:00:13.664899 18612 raft_consensus.cc:2272] T 11111111111111111111111111111111 P 3c3f2f5f2ca24a9aaf45efcd888046f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:13.674729 18612 tablet_server.cc:195] TabletServer@127.18.45.1:0 shutdown complete.
I20260201 09:00:13.684170 18612 master.cc:561] Master@127.18.45.62:34563 shutting down...
I20260201 09:00:13.697305 18612 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509 [term 1 LEADER]: Raft consensus shutting down.
I20260201 09:00:13.697686 18612 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:13.698004 18612 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4fe6bf1adcc740ec931b43ae8e248509: stopping tablet replica
I20260201 09:00:13.705461 18612 master.cc:583] Master@127.18.45.62:34563 shutdown complete.
[ OK ] TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors (523 ms)
[----------] 4 tests from TxnStatusTabletManagementTest (3026 ms total)
[----------] 2 tests from FailedTabletsAreReplacedITest
[ RUN ] FailedTabletsAreReplacedITest.OneReplica/0
I20260201 09:00:13.726538 18612 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.45.62:32961
I20260201 09:00:13.727411 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 09:00:13.732800 22228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:13.733227 22227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:13.735169 22230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:13.735545 18612 server_base.cc:1060] running on GCE node
I20260201 09:00:13.736476 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 09:00:13.736714 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 09:00:13.736902 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936413736889 us; error 0 us; skew 500 ppm
I20260201 09:00:13.737668 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 09:00:13.739756 18612 webserver.cc:492] Webserver started at http://127.18.45.62:43067/ using document root <none> and password file <none>
I20260201 09:00:13.740114 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 09:00:13.740252 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 09:00:13.740433 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 09:00:13.741340 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1769936356186478-18612-0/minicluster-data/master-0-root/instance:
uuid: "78f3f83265e74e3ea498cb3852d7725f"
format_stamp: "Formatted at 2026-02-01 09:00:13 on dist-test-slave-zz6f"
I20260201 09:00:13.745124 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260201 09:00:13.747852 22235 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:13.748456 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260201 09:00:13.748701 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1769936356186478-18612-0/minicluster-data/master-0-root
uuid: "78f3f83265e74e3ea498cb3852d7725f"
format_stamp: "Formatted at 2026-02-01 09:00:13 on dist-test-slave-zz6f"
I20260201 09:00:13.749034 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1769936356186478-18612-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1769936356186478-18612-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1769936356186478-18612-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 09:00:13.765064 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 09:00:13.765844 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 09:00:13.796782 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.62:32961
I20260201 09:00:13.796880 22286 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.62:32961 every 8 connection(s)
I20260201 09:00:13.799976 22287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 09:00:13.808476 22287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f: Bootstrap starting.
I20260201 09:00:13.812129 22287 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f: Neither blocks nor log segments found. Creating new log.
I20260201 09:00:13.815343 22287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f: No bootstrap required, opened a new log
I20260201 09:00:13.816968 22287 raft_consensus.cc:359] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78f3f83265e74e3ea498cb3852d7725f" member_type: VOTER }
I20260201 09:00:13.817276 22287 raft_consensus.cc:385] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 09:00:13.817426 22287 raft_consensus.cc:740] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78f3f83265e74e3ea498cb3852d7725f, State: Initialized, Role: FOLLOWER
I20260201 09:00:13.817852 22287 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78f3f83265e74e3ea498cb3852d7725f" member_type: VOTER }
I20260201 09:00:13.818199 22287 raft_consensus.cc:399] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 09:00:13.818363 22287 raft_consensus.cc:493] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 09:00:13.818553 22287 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f [term 0 FOLLOWER]: Advancing to term 1
I20260201 09:00:13.822211 22287 raft_consensus.cc:515] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78f3f83265e74e3ea498cb3852d7725f" member_type: VOTER }
I20260201 09:00:13.822643 22287 leader_election.cc:304] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 78f3f83265e74e3ea498cb3852d7725f; no voters:
I20260201 09:00:13.823657 22287 leader_election.cc:290] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 09:00:13.823880 22290 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 09:00:13.825291 22290 raft_consensus.cc:697] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f [term 1 LEADER]: Becoming Leader. State: Replica: 78f3f83265e74e3ea498cb3852d7725f, State: Running, Role: LEADER
I20260201 09:00:13.825904 22290 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78f3f83265e74e3ea498cb3852d7725f" member_type: VOTER }
I20260201 09:00:13.826493 22287 sys_catalog.cc:565] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f [sys.catalog]: configured and running, proceeding with master startup.
I20260201 09:00:13.828570 22291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "78f3f83265e74e3ea498cb3852d7725f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78f3f83265e74e3ea498cb3852d7725f" member_type: VOTER } }
I20260201 09:00:13.828689 22292 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78f3f83265e74e3ea498cb3852d7725f. Latest consensus state: current_term: 1 leader_uuid: "78f3f83265e74e3ea498cb3852d7725f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78f3f83265e74e3ea498cb3852d7725f" member_type: VOTER } }
I20260201 09:00:13.829298 22292 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f [sys.catalog]: This master's current role is: LEADER
I20260201 09:00:13.830821 22291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f [sys.catalog]: This master's current role is: LEADER
I20260201 09:00:13.831622 22296 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 09:00:13.836071 22296 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 09:00:13.840943 18612 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260201 09:00:13.843658 22296 catalog_manager.cc:1357] Generated new cluster ID: c7083b994f7347b29842983d460a5bde
I20260201 09:00:13.843904 22296 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 09:00:13.869283 22296 catalog_manager.cc:1380] Generated new certificate authority record
I20260201 09:00:13.870368 22296 catalog_manager.cc:1514] Loading token signing keys...
I20260201 09:00:13.882566 22296 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f: Generated new TSK 0
I20260201 09:00:13.883090 22296 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 09:00:13.906572 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 09:00:13.911844 22308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:13.912774 22309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:13.914595 22311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:13.914633 18612 server_base.cc:1060] running on GCE node
I20260201 09:00:13.915688 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 09:00:13.915861 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 09:00:13.915990 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936413915979 us; error 0 us; skew 500 ppm
I20260201 09:00:13.916453 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 09:00:13.918457 18612 webserver.cc:492] Webserver started at http://127.18.45.1:37675/ using document root <none> and password file <none>
I20260201 09:00:13.918857 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 09:00:13.918998 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 09:00:13.919191 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 09:00:13.920085 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1769936356186478-18612-0/minicluster-data/ts-0-root/instance:
uuid: "efbbc45587df4e219b3bc073733d46ed"
format_stamp: "Formatted at 2026-02-01 09:00:13 on dist-test-slave-zz6f"
I20260201 09:00:13.923864 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260201 09:00:13.926728 22316 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:13.927448 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260201 09:00:13.927726 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1769936356186478-18612-0/minicluster-data/ts-0-root
uuid: "efbbc45587df4e219b3bc073733d46ed"
format_stamp: "Formatted at 2026-02-01 09:00:13 on dist-test-slave-zz6f"
I20260201 09:00:13.927985 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1769936356186478-18612-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1769936356186478-18612-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1769936356186478-18612-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 09:00:13.946486 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 09:00:13.947330 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 09:00:13.948508 18612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 09:00:13.950546 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 09:00:13.950726 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:13.950937 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 09:00:13.951081 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:13.985059 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.1:37183
I20260201 09:00:13.985148 22378 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.1:37183 every 8 connection(s)
I20260201 09:00:13.989068 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 09:00:13.995221 22383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:13.995967 22384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:13.998373 22386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:14.000134 18612 server_base.cc:1060] running on GCE node
I20260201 09:00:14.001000 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260201 09:00:14.001060 22379 heartbeater.cc:344] Connected to a master server at 127.18.45.62:32961
W20260201 09:00:14.001319 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 09:00:14.001469 22379 heartbeater.cc:461] Registering TS with master...
I20260201 09:00:14.001502 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936414001486 us; error 0 us; skew 500 ppm
I20260201 09:00:14.002182 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 09:00:14.002221 22379 heartbeater.cc:507] Master 127.18.45.62:32961 requested a full tablet report, sending...
I20260201 09:00:14.004046 22252 ts_manager.cc:194] Registered new tserver with Master: efbbc45587df4e219b3bc073733d46ed (127.18.45.1:37183)
I20260201 09:00:14.004460 18612 webserver.cc:492] Webserver started at http://127.18.45.2:45539/ using document root <none> and password file <none>
I20260201 09:00:14.005008 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 09:00:14.005218 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 09:00:14.005467 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 09:00:14.005882 22252 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50548
I20260201 09:00:14.006462 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1769936356186478-18612-0/minicluster-data/ts-1-root/instance:
uuid: "691c9bab7f1149b58be63136e62073de"
format_stamp: "Formatted at 2026-02-01 09:00:14 on dist-test-slave-zz6f"
I20260201 09:00:14.010371 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260201 09:00:14.013243 22391 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:14.013870 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260201 09:00:14.014124 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1769936356186478-18612-0/minicluster-data/ts-1-root
uuid: "691c9bab7f1149b58be63136e62073de"
format_stamp: "Formatted at 2026-02-01 09:00:14 on dist-test-slave-zz6f"
I20260201 09:00:14.014357 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1769936356186478-18612-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1769936356186478-18612-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1769936356186478-18612-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 09:00:14.032249 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 09:00:14.033115 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 09:00:14.034453 18612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 09:00:14.036396 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 09:00:14.036597 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:14.036831 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 09:00:14.036995 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260201 09:00:14.069118 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.2:34751
I20260201 09:00:14.069207 22453 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.2:34751 every 8 connection(s)
I20260201 09:00:14.073452 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 09:00:14.079337 22457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:14.080163 22458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:14.082911 22460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:14.084074 18612 server_base.cc:1060] running on GCE node
I20260201 09:00:14.084942 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 09:00:14.085189 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 09:00:14.085183 22454 heartbeater.cc:344] Connected to a master server at 127.18.45.62:32961
I20260201 09:00:14.085486 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936414085470 us; error 0 us; skew 500 ppm
I20260201 09:00:14.085747 22454 heartbeater.cc:461] Registering TS with master...
I20260201 09:00:14.086097 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 09:00:14.086342 22454 heartbeater.cc:507] Master 127.18.45.62:32961 requested a full tablet report, sending...
I20260201 09:00:14.088333 22252 ts_manager.cc:194] Registered new tserver with Master: 691c9bab7f1149b58be63136e62073de (127.18.45.2:34751)
I20260201 09:00:14.088629 18612 webserver.cc:492] Webserver started at http://127.18.45.3:40145/ using document root <none> and password file <none>
I20260201 09:00:14.089243 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 09:00:14.089498 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 09:00:14.089870 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 09:00:14.090171 22252 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50554
I20260201 09:00:14.091219 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1769936356186478-18612-0/minicluster-data/ts-2-root/instance:
uuid: "2263c735ceb84246b4773b6be6cb56e0"
format_stamp: "Formatted at 2026-02-01 09:00:14 on dist-test-slave-zz6f"
I20260201 09:00:14.095114 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260201 09:00:14.098030 22465 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:14.098904 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260201 09:00:14.099233 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1769936356186478-18612-0/minicluster-data/ts-2-root
uuid: "2263c735ceb84246b4773b6be6cb56e0"
format_stamp: "Formatted at 2026-02-01 09:00:14 on dist-test-slave-zz6f"
I20260201 09:00:14.099488 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1769936356186478-18612-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1769936356186478-18612-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1769936356186478-18612-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 09:00:14.122503 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 09:00:14.123293 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 09:00:14.124493 18612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 09:00:14.126497 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 09:00:14.126708 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:14.126904 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 09:00:14.127049 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:14.160144 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.3:36237
I20260201 09:00:14.160243 22527 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.3:36237 every 8 connection(s)
I20260201 09:00:14.172289 22528 heartbeater.cc:344] Connected to a master server at 127.18.45.62:32961
I20260201 09:00:14.172631 22528 heartbeater.cc:461] Registering TS with master...
I20260201 09:00:14.173204 22528 heartbeater.cc:507] Master 127.18.45.62:32961 requested a full tablet report, sending...
I20260201 09:00:14.174676 22252 ts_manager.cc:194] Registered new tserver with Master: 2263c735ceb84246b4773b6be6cb56e0 (127.18.45.3:36237)
I20260201 09:00:14.175257 18612 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.012018017s
I20260201 09:00:14.175932 22252 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50564
I20260201 09:00:14.209566 22252 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50582:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260201 09:00:14.242237 22419 tablet_service.cc:1505] Processing CreateTablet for tablet 7ef9db03c9b142b78d47c3598fa1bc6d (DEFAULT_TABLE table=test-workload [id=64e92c4c024a4ca1a2c1840597d94481]), partition=RANGE (key) PARTITION UNBOUNDED
I20260201 09:00:14.243846 22419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef9db03c9b142b78d47c3598fa1bc6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 09:00:14.254105 22344 tablet_service.cc:1505] Processing CreateTablet for tablet 7ef9db03c9b142b78d47c3598fa1bc6d (DEFAULT_TABLE table=test-workload [id=64e92c4c024a4ca1a2c1840597d94481]), partition=RANGE (key) PARTITION UNBOUNDED
I20260201 09:00:14.255255 22344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef9db03c9b142b78d47c3598fa1bc6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 09:00:14.261775 22548 tablet_bootstrap.cc:492] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de: Bootstrap starting.
I20260201 09:00:14.262421 22493 tablet_service.cc:1505] Processing CreateTablet for tablet 7ef9db03c9b142b78d47c3598fa1bc6d (DEFAULT_TABLE table=test-workload [id=64e92c4c024a4ca1a2c1840597d94481]), partition=RANGE (key) PARTITION UNBOUNDED
I20260201 09:00:14.263685 22493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef9db03c9b142b78d47c3598fa1bc6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 09:00:14.267366 22548 tablet_bootstrap.cc:654] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de: Neither blocks nor log segments found. Creating new log.
I20260201 09:00:14.271687 22549 tablet_bootstrap.cc:492] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed: Bootstrap starting.
I20260201 09:00:14.276975 22551 tablet_bootstrap.cc:492] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0: Bootstrap starting.
I20260201 09:00:14.278290 22548 tablet_bootstrap.cc:492] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de: No bootstrap required, opened a new log
I20260201 09:00:14.278730 22548 ts_tablet_manager.cc:1403] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.005s
I20260201 09:00:14.279798 22549 tablet_bootstrap.cc:654] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed: Neither blocks nor log segments found. Creating new log.
I20260201 09:00:14.281400 22548 raft_consensus.cc:359] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691c9bab7f1149b58be63136e62073de" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 34751 } } peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } }
I20260201 09:00:14.282160 22548 raft_consensus.cc:385] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 09:00:14.282593 22551 tablet_bootstrap.cc:654] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0: Neither blocks nor log segments found. Creating new log.
I20260201 09:00:14.282537 22548 raft_consensus.cc:740] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691c9bab7f1149b58be63136e62073de, State: Initialized, Role: FOLLOWER
I20260201 09:00:14.283586 22548 consensus_queue.cc:260] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691c9bab7f1149b58be63136e62073de" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 34751 } } peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } }
I20260201 09:00:14.284523 22549 tablet_bootstrap.cc:492] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed: No bootstrap required, opened a new log
I20260201 09:00:14.285058 22549 ts_tablet_manager.cc:1403] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.003s
I20260201 09:00:14.286686 22454 heartbeater.cc:499] Master 127.18.45.62:32961 was elected leader, sending a full tablet report...
I20260201 09:00:14.287144 22551 tablet_bootstrap.cc:492] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0: No bootstrap required, opened a new log
I20260201 09:00:14.287294 22548 ts_tablet_manager.cc:1434] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de: Time spent starting tablet: real 0.008s user 0.005s sys 0.003s
I20260201 09:00:14.287688 22551 ts_tablet_manager.cc:1403] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.004s
I20260201 09:00:14.287894 22549 raft_consensus.cc:359] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691c9bab7f1149b58be63136e62073de" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 34751 } } peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } }
I20260201 09:00:14.288614 22549 raft_consensus.cc:385] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 09:00:14.288938 22549 raft_consensus.cc:740] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efbbc45587df4e219b3bc073733d46ed, State: Initialized, Role: FOLLOWER
I20260201 09:00:14.289655 22549 consensus_queue.cc:260] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691c9bab7f1149b58be63136e62073de" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 34751 } } peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } }
I20260201 09:00:14.290542 22551 raft_consensus.cc:359] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691c9bab7f1149b58be63136e62073de" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 34751 } } peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } }
I20260201 09:00:14.291124 22551 raft_consensus.cc:385] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 09:00:14.291425 22551 raft_consensus.cc:740] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2263c735ceb84246b4773b6be6cb56e0, State: Initialized, Role: FOLLOWER
I20260201 09:00:14.292423 22379 heartbeater.cc:499] Master 127.18.45.62:32961 was elected leader, sending a full tablet report...
I20260201 09:00:14.292110 22551 consensus_queue.cc:260] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691c9bab7f1149b58be63136e62073de" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 34751 } } peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } }
I20260201 09:00:14.292582 22549 ts_tablet_manager.cc:1434] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260201 09:00:14.294704 22528 heartbeater.cc:499] Master 127.18.45.62:32961 was elected leader, sending a full tablet report...
I20260201 09:00:14.295611 22551 ts_tablet_manager.cc:1434] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0: Time spent starting tablet: real 0.008s user 0.006s sys 0.001s
I20260201 09:00:14.659608 22555 raft_consensus.cc:493] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:14.660035 22555 raft_consensus.cc:515] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691c9bab7f1149b58be63136e62073de" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 34751 } } peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } }
I20260201 09:00:14.661841 22555 leader_election.cc:290] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691c9bab7f1149b58be63136e62073de (127.18.45.2:34751), 2263c735ceb84246b4773b6be6cb56e0 (127.18.45.3:36237)
I20260201 09:00:14.662762 22554 raft_consensus.cc:493] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:14.663249 22554 raft_consensus.cc:515] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691c9bab7f1149b58be63136e62073de" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 34751 } } peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } }
I20260201 09:00:14.672513 22554 leader_election.cc:290] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efbbc45587df4e219b3bc073733d46ed (127.18.45.1:37183), 2263c735ceb84246b4773b6be6cb56e0 (127.18.45.3:36237)
I20260201 09:00:14.677276 22429 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ef9db03c9b142b78d47c3598fa1bc6d" candidate_uuid: "efbbc45587df4e219b3bc073733d46ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691c9bab7f1149b58be63136e62073de" is_pre_election: true
I20260201 09:00:14.678064 22429 raft_consensus.cc:2468] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efbbc45587df4e219b3bc073733d46ed in term 0.
I20260201 09:00:14.679415 22318 leader_election.cc:304] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691c9bab7f1149b58be63136e62073de, efbbc45587df4e219b3bc073733d46ed; no voters:
I20260201 09:00:14.680264 22555 raft_consensus.cc:2804] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 09:00:14.680625 22555 raft_consensus.cc:493] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:14.681015 22555 raft_consensus.cc:3060] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [term 0 FOLLOWER]: Advancing to term 1
I20260201 09:00:14.680877 22503 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ef9db03c9b142b78d47c3598fa1bc6d" candidate_uuid: "efbbc45587df4e219b3bc073733d46ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2263c735ceb84246b4773b6be6cb56e0" is_pre_election: true
I20260201 09:00:14.681797 22503 raft_consensus.cc:2468] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efbbc45587df4e219b3bc073733d46ed in term 0.
I20260201 09:00:14.687004 22354 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ef9db03c9b142b78d47c3598fa1bc6d" candidate_uuid: "691c9bab7f1149b58be63136e62073de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efbbc45587df4e219b3bc073733d46ed" is_pre_election: true
I20260201 09:00:14.687903 22503 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ef9db03c9b142b78d47c3598fa1bc6d" candidate_uuid: "691c9bab7f1149b58be63136e62073de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2263c735ceb84246b4773b6be6cb56e0" is_pre_election: true
I20260201 09:00:14.688351 22503 raft_consensus.cc:2468] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691c9bab7f1149b58be63136e62073de in term 0.
I20260201 09:00:14.688241 22555 raft_consensus.cc:515] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691c9bab7f1149b58be63136e62073de" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 34751 } } peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } }
I20260201 09:00:14.689327 22354 raft_consensus.cc:2393] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691c9bab7f1149b58be63136e62073de in current term 1: Already voted for candidate efbbc45587df4e219b3bc073733d46ed in this term.
I20260201 09:00:14.689478 22394 leader_election.cc:304] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2263c735ceb84246b4773b6be6cb56e0, 691c9bab7f1149b58be63136e62073de; no voters:
I20260201 09:00:14.690080 22555 leader_election.cc:290] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [CANDIDATE]: Term 1 election: Requested vote from peers 691c9bab7f1149b58be63136e62073de (127.18.45.2:34751), 2263c735ceb84246b4773b6be6cb56e0 (127.18.45.3:36237)
I20260201 09:00:14.690383 22554 raft_consensus.cc:2804] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 09:00:14.690781 22554 raft_consensus.cc:493] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:14.690876 22429 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ef9db03c9b142b78d47c3598fa1bc6d" candidate_uuid: "efbbc45587df4e219b3bc073733d46ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691c9bab7f1149b58be63136e62073de"
I20260201 09:00:14.691179 22554 raft_consensus.cc:3060] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [term 0 FOLLOWER]: Advancing to term 1
I20260201 09:00:14.691761 22503 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ef9db03c9b142b78d47c3598fa1bc6d" candidate_uuid: "efbbc45587df4e219b3bc073733d46ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2263c735ceb84246b4773b6be6cb56e0"
I20260201 09:00:14.692307 22503 raft_consensus.cc:3060] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0 [term 0 FOLLOWER]: Advancing to term 1
I20260201 09:00:14.697597 22554 raft_consensus.cc:515] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691c9bab7f1149b58be63136e62073de" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 34751 } } peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } }
I20260201 09:00:14.698611 22429 raft_consensus.cc:2393] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate efbbc45587df4e219b3bc073733d46ed in current term 1: Already voted for candidate 691c9bab7f1149b58be63136e62073de in this term.
I20260201 09:00:14.698607 22503 raft_consensus.cc:2468] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efbbc45587df4e219b3bc073733d46ed in term 1.
I20260201 09:00:14.699698 22554 leader_election.cc:290] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [CANDIDATE]: Term 1 election: Requested vote from peers efbbc45587df4e219b3bc073733d46ed (127.18.45.1:37183), 2263c735ceb84246b4773b6be6cb56e0 (127.18.45.3:36237)
I20260201 09:00:14.699653 22319 leader_election.cc:304] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2263c735ceb84246b4773b6be6cb56e0, efbbc45587df4e219b3bc073733d46ed; no voters:
I20260201 09:00:14.700278 22354 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ef9db03c9b142b78d47c3598fa1bc6d" candidate_uuid: "691c9bab7f1149b58be63136e62073de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efbbc45587df4e219b3bc073733d46ed"
I20260201 09:00:14.700488 22555 raft_consensus.cc:2804] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [term 1 FOLLOWER]: Leader election won for term 1
I20260201 09:00:14.700970 22503 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ef9db03c9b142b78d47c3598fa1bc6d" candidate_uuid: "691c9bab7f1149b58be63136e62073de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2263c735ceb84246b4773b6be6cb56e0"
I20260201 09:00:14.701370 22555 raft_consensus.cc:697] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [term 1 LEADER]: Becoming Leader. State: Replica: efbbc45587df4e219b3bc073733d46ed, State: Running, Role: LEADER
I20260201 09:00:14.701684 22503 raft_consensus.cc:2393] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 691c9bab7f1149b58be63136e62073de in current term 1: Already voted for candidate efbbc45587df4e219b3bc073733d46ed in this term.
I20260201 09:00:14.702288 22555 consensus_queue.cc:237] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691c9bab7f1149b58be63136e62073de" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 34751 } } peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } }
I20260201 09:00:14.706513 22392 leader_election.cc:304] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691c9bab7f1149b58be63136e62073de; no voters: 2263c735ceb84246b4773b6be6cb56e0, efbbc45587df4e219b3bc073733d46ed
I20260201 09:00:14.707166 22554 raft_consensus.cc:2749] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260201 09:00:14.708738 22250 catalog_manager.cc:5654] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed reported cstate change: term changed from 0 to 1, leader changed from <none> to efbbc45587df4e219b3bc073733d46ed (127.18.45.1). New cstate: current_term: 1 leader_uuid: "efbbc45587df4e219b3bc073733d46ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691c9bab7f1149b58be63136e62073de" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 34751 } } peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } } }
I20260201 09:00:15.053601 22493 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:15.055652 22419 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:15.055922 22344 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260201 09:00:15.088711 22555 consensus_queue.cc:1048] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "691c9bab7f1149b58be63136e62073de" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 34751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 09:00:15.148685 22555 consensus_queue.cc:1048] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Master Summary
UUID | Address | Status
----------------------------------+--------------------+---------
78f3f83265e74e3ea498cb3852d7725f | 127.18.45.62:32961 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
2263c735ceb84246b4773b6be6cb56e0 | 127.18.45.3:36237 | HEALTHY | <none> | 0 | 0
691c9bab7f1149b58be63136e62073de | 127.18.45.2:34751 | HEALTHY | <none> | 0 | 0
efbbc45587df4e219b3bc073733d46ed | 127.18.45.1:37183 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet 7ef9db03c9b142b78d47c3598fa1bc6d of table 'test-workload' is conflicted: 2 replicas' active configs disagree with the leader master's
691c9bab7f1149b58be63136e62073de (127.18.45.2:34751): RUNNING
efbbc45587df4e219b3bc073733d46ed (127.18.45.1:37183): RUNNING [LEADER]
2263c735ceb84246b4773b6be6cb56e0 (127.18.45.3:36237): RUNNING
All reported replicas are:
A = 691c9bab7f1149b58be63136e62073de
B = efbbc45587df4e219b3bc073733d46ed
C = 2263c735ceb84246b4773b6be6cb56e0
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
master | A B* C | | | Yes
A | A B C | 1 | -1 | Yes
B | A B* C | 1 | -1 | Yes
C | A B C | 1 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | CONSENSUS_MISMATCH | 1 | 0 | 0 | 0 | 1
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260201 09:00:15.295712 18612 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260201 09:00:15.635972 22493 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:15.646322 22344 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260201 09:00:15.648078 22419 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+--------------------+---------
78f3f83265e74e3ea498cb3852d7725f | 127.18.45.62:32961 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
2263c735ceb84246b4773b6be6cb56e0 | 127.18.45.3:36237 | HEALTHY | <none> | 0 | 0
691c9bab7f1149b58be63136e62073de | 127.18.45.2:34751 | HEALTHY | <none> | 0 | 0
efbbc45587df4e219b3bc073733d46ed | 127.18.45.1:37183 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
test-workload | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260201 09:00:15.821978 18612 log_verifier.cc:126] Checking tablet 7ef9db03c9b142b78d47c3598fa1bc6d
I20260201 09:00:15.876988 18612 log_verifier.cc:177] Verified matching terms for 1 ops in tablet 7ef9db03c9b142b78d47c3598fa1bc6d
I20260201 09:00:15.877563 18612 tablet_replica.cc:333] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de: stopping tablet replica
I20260201 09:00:15.878360 18612 raft_consensus.cc:2243] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 09:00:15.878911 18612 raft_consensus.cc:2272] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:16.061637 22493 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:16.063812 22419 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:16.066080 22344 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260201 09:00:16.150178 22318 consensus_peers.cc:597] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed -> Peer 691c9bab7f1149b58be63136e62073de (127.18.45.2:34751): Couldn't send request to peer 691c9bab7f1149b58be63136e62073de. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: IO error: INJECTED ERROR: tablet failed. This is attempt 1: this message will repeat every 5th retry.
I20260201 09:00:16.159842 22646 raft_consensus.cc:1012] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed: Attempting to remove follower 691c9bab7f1149b58be63136e62073de from the Raft config. Reason: The tablet replica hosted on peer 691c9bab7f1149b58be63136e62073de has failed
I20260201 09:00:16.162200 22646 consensus_queue.cc:237] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } }
I20260201 09:00:16.176751 22503 raft_consensus.cc:1275] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0 [term 1 FOLLOWER]: Refusing update from remote peer efbbc45587df4e219b3bc073733d46ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 09:00:16.178378 22555 consensus_queue.cc:1048] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 09:00:16.188630 22646 raft_consensus.cc:2955] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 691c9bab7f1149b58be63136e62073de (127.18.45.2) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } } }
I20260201 09:00:16.203853 22251 catalog_manager.cc:5654] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed reported cstate change: config changed from index -1 to 2, VOTER 691c9bab7f1149b58be63136e62073de (127.18.45.2) evicted. New cstate: current_term: 1 leader_uuid: "efbbc45587df4e219b3bc073733d46ed" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } } }
I20260201 09:00:16.207685 22503 raft_consensus.cc:2955] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 691c9bab7f1149b58be63136e62073de (127.18.45.2) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } } }
I20260201 09:00:16.235927 22419 tablet_service.cc:1552] Processing DeleteTablet for tablet 7ef9db03c9b142b78d47c3598fa1bc6d with delete_type TABLET_DATA_TOMBSTONED (TS 691c9bab7f1149b58be63136e62073de not found in new config with opid_index 2) from {username='slave'} at 127.0.0.1:37598
I20260201 09:00:16.236783 22354 consensus_queue.cc:237] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } } peers { permanent_uuid: "691c9bab7f1149b58be63136e62073de" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 34751 } }
I20260201 09:00:16.241930 22503 raft_consensus.cc:1275] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0 [term 1 FOLLOWER]: Refusing update from remote peer efbbc45587df4e219b3bc073733d46ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260201 09:00:16.242022 22318 consensus_peers.cc:597] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed -> Peer 691c9bab7f1149b58be63136e62073de (127.18.45.2:34751): Couldn't send request to peer 691c9bab7f1149b58be63136e62073de. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: IO error: INJECTED ERROR: tablet failed. This is attempt 1: this message will repeat every 5th retry.
I20260201 09:00:16.243266 22555 consensus_queue.cc:1048] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 09:00:16.248610 22648 raft_consensus.cc:2955] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 691c9bab7f1149b58be63136e62073de (127.18.45.2) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } } peers { permanent_uuid: "691c9bab7f1149b58be63136e62073de" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 34751 } } }
I20260201 09:00:16.250244 22503 raft_consensus.cc:2955] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 691c9bab7f1149b58be63136e62073de (127.18.45.2) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } } peers { permanent_uuid: "691c9bab7f1149b58be63136e62073de" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 34751 } } }
I20260201 09:00:16.257769 22654 ts_tablet_manager.cc:1916] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 09:00:16.258730 22236 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:VOTER RPC for tablet 7ef9db03c9b142b78d47c3598fa1bc6d with cas_config_opid_index 2: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260201 09:00:16.264143 22251 catalog_manager.cc:5654] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0 reported cstate change: config changed from index 2 to 3, VOTER 691c9bab7f1149b58be63136e62073de (127.18.45.2) added. New cstate: current_term: 1 leader_uuid: "efbbc45587df4e219b3bc073733d46ed" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } } peers { permanent_uuid: "691c9bab7f1149b58be63136e62073de" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 34751 } } }
I20260201 09:00:16.275637 22654 ts_tablet_manager.cc:1929] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260201 09:00:16.275972 22654 log.cc:1199] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de: Deleting WAL directory at /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1769936356186478-18612-0/minicluster-data/ts-1-root/wals/7ef9db03c9b142b78d47c3598fa1bc6d
I20260201 09:00:16.277336 22237 catalog_manager.cc:4985] TS 691c9bab7f1149b58be63136e62073de (127.18.45.2:34751): tablet 7ef9db03c9b142b78d47c3598fa1bc6d (table test-workload [id=64e92c4c024a4ca1a2c1840597d94481]) successfully deleted
Master Summary
UUID | Address | Status
----------------------------------+--------------------+---------
78f3f83265e74e3ea498cb3852d7725f | 127.18.45.62:32961 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
2263c735ceb84246b4773b6be6cb56e0 | 127.18.45.3:36237 | HEALTHY | <none> | 0 | 0
691c9bab7f1149b58be63136e62073de | 127.18.45.2:34751 | HEALTHY | <none> | 0 | 0
efbbc45587df4e219b3bc073733d46ed | 127.18.45.1:37183 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet 7ef9db03c9b142b78d47c3598fa1bc6d of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
691c9bab7f1149b58be63136e62073de (127.18.45.2:34751): not running
State: FAILED
Data state: TABLET_DATA_READY
Last status: IO error: INJECTED ERROR: tablet failed
efbbc45587df4e219b3bc073733d46ed (127.18.45.1:37183): RUNNING [LEADER]
2263c735ceb84246b4773b6be6cb56e0 (127.18.45.3:36237): RUNNING
All reported replicas are:
A = 691c9bab7f1149b58be63136e62073de
B = efbbc45587df4e219b3bc073733d46ed
C = 2263c735ceb84246b4773b6be6cb56e0
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
master | A B* C | | | Yes
A | [config not available] | | |
B | A B* C | 1 | -1 | Yes
C | A B* C | 1 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | UNDER_REPLICATED | 1 | 0 | 0 | 1 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260201 09:00:16.302857 18612 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260201 09:00:16.679839 22493 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:16.688802 22419 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:16.693305 22344 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260201 09:00:16.740967 22648 raft_consensus.cc:1012] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed: Attempting to remove follower 691c9bab7f1149b58be63136e62073de from the Raft config. Reason: The tablet replica hosted on peer 691c9bab7f1149b58be63136e62073de has failed
I20260201 09:00:16.743356 22648 consensus_queue.cc:237] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } }
I20260201 09:00:16.749557 22503 raft_consensus.cc:1275] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0 [term 1 FOLLOWER]: Refusing update from remote peer efbbc45587df4e219b3bc073733d46ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 09:00:16.751225 22555 consensus_queue.cc:1048] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 09:00:16.759608 22648 raft_consensus.cc:2955] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 691c9bab7f1149b58be63136e62073de (127.18.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } } }
I20260201 09:00:16.777328 22503 raft_consensus.cc:2955] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 691c9bab7f1149b58be63136e62073de (127.18.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } } }
I20260201 09:00:16.792304 22252 catalog_manager.cc:5654] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed reported cstate change: config changed from index 3 to 4, VOTER 691c9bab7f1149b58be63136e62073de (127.18.45.2) evicted. New cstate: current_term: 1 leader_uuid: "efbbc45587df4e219b3bc073733d46ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } } }
I20260201 09:00:16.835014 22419 tablet_service.cc:1552] Processing DeleteTablet for tablet 7ef9db03c9b142b78d47c3598fa1bc6d with delete_type TABLET_DATA_TOMBSTONED (TS 691c9bab7f1149b58be63136e62073de not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37598
I20260201 09:00:16.837462 22354 consensus_queue.cc:237] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } } peers { permanent_uuid: "691c9bab7f1149b58be63136e62073de" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 34751 } }
I20260201 09:00:16.843585 22503 raft_consensus.cc:1275] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0 [term 1 FOLLOWER]: Refusing update from remote peer efbbc45587df4e219b3bc073733d46ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
W20260201 09:00:16.843637 22318 consensus_peers.cc:597] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed -> Peer 691c9bab7f1149b58be63136e62073de (127.18.45.2:34751): Couldn't send request to peer 691c9bab7f1149b58be63136e62073de. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: FAILED. This is attempt 1: this message will repeat every 5th retry.
I20260201 09:00:16.844913 22648 consensus_queue.cc:1048] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 09:00:16.849927 22237 catalog_manager.cc:4985] TS 691c9bab7f1149b58be63136e62073de (127.18.45.2:34751): tablet 7ef9db03c9b142b78d47c3598fa1bc6d (table test-workload [id=64e92c4c024a4ca1a2c1840597d94481]) successfully deleted
I20260201 09:00:16.851764 22555 raft_consensus.cc:2955] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 691c9bab7f1149b58be63136e62073de (127.18.45.2) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } } peers { permanent_uuid: "691c9bab7f1149b58be63136e62073de" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 34751 } } }
I20260201 09:00:16.853035 22503 raft_consensus.cc:2955] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 691c9bab7f1149b58be63136e62073de (127.18.45.2) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } } peers { permanent_uuid: "691c9bab7f1149b58be63136e62073de" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 34751 } } }
I20260201 09:00:16.861963 22236 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:VOTER RPC for tablet 7ef9db03c9b142b78d47c3598fa1bc6d with cas_config_opid_index 4: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260201 09:00:16.864941 22251 catalog_manager.cc:5654] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed reported cstate change: config changed from index 4 to 5, VOTER 691c9bab7f1149b58be63136e62073de (127.18.45.2) added. New cstate: current_term: 1 leader_uuid: "efbbc45587df4e219b3bc073733d46ed" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } } peers { permanent_uuid: "691c9bab7f1149b58be63136e62073de" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 34751 } } }
Master Summary
UUID | Address | Status
----------------------------------+--------------------+---------
78f3f83265e74e3ea498cb3852d7725f | 127.18.45.62:32961 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
2263c735ceb84246b4773b6be6cb56e0 | 127.18.45.3:36237 | HEALTHY | <none> | 0 | 0
691c9bab7f1149b58be63136e62073de | 127.18.45.2:34751 | HEALTHY | <none> | 0 | 0
efbbc45587df4e219b3bc073733d46ed | 127.18.45.1:37183 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet 7ef9db03c9b142b78d47c3598fa1bc6d of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
efbbc45587df4e219b3bc073733d46ed (127.18.45.1:37183): RUNNING [LEADER]
2263c735ceb84246b4773b6be6cb56e0 (127.18.45.3:36237): RUNNING
691c9bab7f1149b58be63136e62073de (127.18.45.2:34751): not running
State: FAILED
Data state: TABLET_DATA_TOMBSTONED
Last status: Deleted tablet blocks from disk
All reported replicas are:
A = efbbc45587df4e219b3bc073733d46ed
B = 2263c735ceb84246b4773b6be6cb56e0
C = 691c9bab7f1149b58be63136e62073de
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
master | A* B C | | | Yes
A | A* B C | 1 | 3 | Yes
B | A* B C | 1 | 3 | Yes
C | [config not available] | | |
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | UNDER_REPLICATED | 1 | 0 | 0 | 1 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260201 09:00:16.918341 18612 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260201 09:00:17.320289 22493 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:17.321828 22419 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:17.323750 22344 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260201 09:00:17.380580 22715 ts_tablet_manager.cc:933] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de: Initiating tablet copy from peer efbbc45587df4e219b3bc073733d46ed (127.18.45.1:37183)
I20260201 09:00:17.393553 22715 tablet_copy_client.cc:323] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de: tablet copy: Beginning tablet copy session from remote peer at address 127.18.45.1:37183
I20260201 09:00:17.395221 22364 tablet_copy_service.cc:140] P efbbc45587df4e219b3bc073733d46ed: Received BeginTabletCopySession request for tablet 7ef9db03c9b142b78d47c3598fa1bc6d from peer 691c9bab7f1149b58be63136e62073de ({username='slave'} at 127.0.0.1:45210)
I20260201 09:00:17.395707 22364 tablet_copy_service.cc:161] P efbbc45587df4e219b3bc073733d46ed: Beginning new tablet copy session on tablet 7ef9db03c9b142b78d47c3598fa1bc6d from peer 691c9bab7f1149b58be63136e62073de at {username='slave'} at 127.0.0.1:45210: session id = 691c9bab7f1149b58be63136e62073de-7ef9db03c9b142b78d47c3598fa1bc6d
I20260201 09:00:17.402987 22364 tablet_copy_source_session.cc:215] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 09:00:17.405362 22715 ts_tablet_manager.cc:1916] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260201 09:00:17.418319 22715 ts_tablet_manager.cc:1929] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.1
I20260201 09:00:17.419106 22715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef9db03c9b142b78d47c3598fa1bc6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 09:00:17.427098 22715 tablet_copy_client.cc:806] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de: tablet copy: Starting download of 0 data blocks...
I20260201 09:00:17.427652 22715 tablet_copy_client.cc:670] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de: tablet copy: Starting download of 1 WAL segments...
I20260201 09:00:17.431342 22715 tablet_copy_client.cc:538] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 09:00:17.438241 22715 tablet_bootstrap.cc:492] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de: Bootstrap starting.
I20260201 09:00:17.469858 22715 tablet_bootstrap.cc:492] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 09:00:17.470803 22715 tablet_bootstrap.cc:492] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de: Bootstrap complete.
I20260201 09:00:17.471446 22715 ts_tablet_manager.cc:1403] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de: Time spent bootstrapping tablet: real 0.033s user 0.029s sys 0.003s
I20260201 09:00:17.473836 22715 raft_consensus.cc:359] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } } peers { permanent_uuid: "691c9bab7f1149b58be63136e62073de" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 34751 } }
I20260201 09:00:17.474557 22715 raft_consensus.cc:740] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691c9bab7f1149b58be63136e62073de, State: Initialized, Role: FOLLOWER
I20260201 09:00:17.475337 22715 consensus_queue.cc:260] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "efbbc45587df4e219b3bc073733d46ed" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 37183 } } peers { permanent_uuid: "2263c735ceb84246b4773b6be6cb56e0" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 36237 } } peers { permanent_uuid: "691c9bab7f1149b58be63136e62073de" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 34751 } }
I20260201 09:00:17.490326 22715 ts_tablet_manager.cc:1434] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de: Time spent starting tablet: real 0.019s user 0.014s sys 0.003s
I20260201 09:00:17.491968 22364 tablet_copy_service.cc:342] P efbbc45587df4e219b3bc073733d46ed: Request end of tablet copy session 691c9bab7f1149b58be63136e62073de-7ef9db03c9b142b78d47c3598fa1bc6d received from {username='slave'} at 127.0.0.1:45210
I20260201 09:00:17.492391 22364 tablet_copy_service.cc:434] P efbbc45587df4e219b3bc073733d46ed: ending tablet copy session 691c9bab7f1149b58be63136e62073de-7ef9db03c9b142b78d47c3598fa1bc6d on tablet 7ef9db03c9b142b78d47c3598fa1bc6d with peer 691c9bab7f1149b58be63136e62073de
Master Summary
UUID | Address | Status
----------------------------------+--------------------+---------
78f3f83265e74e3ea498cb3852d7725f | 127.18.45.62:32961 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
2263c735ceb84246b4773b6be6cb56e0 | 127.18.45.3:36237 | HEALTHY | <none> | 0 | 0
691c9bab7f1149b58be63136e62073de | 127.18.45.2:34751 | HEALTHY | <none> | 0 | 0
efbbc45587df4e219b3bc073733d46ed | 127.18.45.1:37183 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet 7ef9db03c9b142b78d47c3598fa1bc6d of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
efbbc45587df4e219b3bc073733d46ed (127.18.45.1:37183): RUNNING [LEADER]
2263c735ceb84246b4773b6be6cb56e0 (127.18.45.3:36237): RUNNING
691c9bab7f1149b58be63136e62073de (127.18.45.2:34751): not running
State: FAILED
Data state: TABLET_DATA_TOMBSTONED
Last status: Deleted tablet blocks from disk
All reported replicas are:
A = efbbc45587df4e219b3bc073733d46ed
B = 2263c735ceb84246b4773b6be6cb56e0
C = 691c9bab7f1149b58be63136e62073de
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
master | A* B C | | | Yes
A | A* B C | 1 | 5 | Yes
B | A* B C | 1 | 5 | Yes
C | [config not available] | | |
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | UNDER_REPLICATED | 1 | 0 | 0 | 1 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260201 09:00:17.531627 18612 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260201 09:00:17.803648 22428 raft_consensus.cc:1217] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20260201 09:00:18.052358 22493 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:18.057911 22419 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:18.059608 22344 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+--------------------+---------
78f3f83265e74e3ea498cb3852d7725f | 127.18.45.62:32961 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
2263c735ceb84246b4773b6be6cb56e0 | 127.18.45.3:36237 | HEALTHY | <none> | 0 | 0
691c9bab7f1149b58be63136e62073de | 127.18.45.2:34751 | HEALTHY | <none> | 0 | 0
efbbc45587df4e219b3bc073733d46ed | 127.18.45.1:37183 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
test-workload | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260201 09:00:18.224076 18612 log_verifier.cc:126] Checking tablet 7ef9db03c9b142b78d47c3598fa1bc6d
I20260201 09:00:18.272522 18612 log_verifier.cc:177] Verified matching terms for 5 ops in tablet 7ef9db03c9b142b78d47c3598fa1bc6d
I20260201 09:00:18.277171 18612 tablet_server.cc:178] TabletServer@127.18.45.1:0 shutting down...
I20260201 09:00:18.298209 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 09:00:18.298847 18612 tablet_replica.cc:333] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed: stopping tablet replica
I20260201 09:00:18.299283 18612 raft_consensus.cc:2243] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [term 1 LEADER]: Raft consensus shutting down.
I20260201 09:00:18.300014 18612 raft_consensus.cc:2272] T 7ef9db03c9b142b78d47c3598fa1bc6d P efbbc45587df4e219b3bc073733d46ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:18.318858 18612 tablet_server.cc:195] TabletServer@127.18.45.1:0 shutdown complete.
I20260201 09:00:18.328035 18612 tablet_server.cc:178] TabletServer@127.18.45.2:0 shutting down...
I20260201 09:00:18.347133 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 09:00:18.347689 18612 tablet_replica.cc:333] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de: stopping tablet replica
I20260201 09:00:18.348143 18612 raft_consensus.cc:2243] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 09:00:18.348453 18612 raft_consensus.cc:2272] T 7ef9db03c9b142b78d47c3598fa1bc6d P 691c9bab7f1149b58be63136e62073de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:18.366370 18612 tablet_server.cc:195] TabletServer@127.18.45.2:0 shutdown complete.
I20260201 09:00:18.378767 18612 tablet_server.cc:178] TabletServer@127.18.45.3:0 shutting down...
I20260201 09:00:18.395399 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 09:00:18.395929 18612 tablet_replica.cc:333] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0: stopping tablet replica
I20260201 09:00:18.396278 18612 raft_consensus.cc:2243] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 09:00:18.396709 18612 raft_consensus.cc:2272] T 7ef9db03c9b142b78d47c3598fa1bc6d P 2263c735ceb84246b4773b6be6cb56e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:18.414633 18612 tablet_server.cc:195] TabletServer@127.18.45.3:0 shutdown complete.
I20260201 09:00:18.423318 18612 master.cc:561] Master@127.18.45.62:32961 shutting down...
I20260201 09:00:18.439811 18612 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f [term 1 LEADER]: Raft consensus shutting down.
I20260201 09:00:18.440228 18612 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:18.440531 18612 tablet_replica.cc:333] T 00000000000000000000000000000000 P 78f3f83265e74e3ea498cb3852d7725f: stopping tablet replica
I20260201 09:00:18.457674 18612 master.cc:583] Master@127.18.45.62:32961 shutdown complete.
[ OK ] FailedTabletsAreReplacedITest.OneReplica/0 (4755 ms)
[ RUN ] FailedTabletsAreReplacedITest.OneReplica/1
I20260201 09:00:18.482126 18612 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.45.62:46397
I20260201 09:00:18.483026 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 09:00:18.487284 22750 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:18.488250 22751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:18.489315 22753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:18.490286 18612 server_base.cc:1060] running on GCE node
I20260201 09:00:18.491012 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 09:00:18.491181 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 09:00:18.491315 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936418491302 us; error 0 us; skew 500 ppm
I20260201 09:00:18.491731 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 09:00:18.493669 18612 webserver.cc:492] Webserver started at http://127.18.45.62:44209/ using document root <none> and password file <none>
I20260201 09:00:18.494092 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 09:00:18.494264 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 09:00:18.494481 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 09:00:18.495359 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/master-0-root/instance:
uuid: "e34920afe4604d4dac3bb771fbffbef1"
format_stamp: "Formatted at 2026-02-01 09:00:18 on dist-test-slave-zz6f"
I20260201 09:00:18.499025 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260201 09:00:18.501715 22758 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:18.502413 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260201 09:00:18.502624 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/master-0-root
uuid: "e34920afe4604d4dac3bb771fbffbef1"
format_stamp: "Formatted at 2026-02-01 09:00:18 on dist-test-slave-zz6f"
I20260201 09:00:18.502820 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 09:00:18.516026 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 09:00:18.516960 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 09:00:18.547853 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.62:46397
I20260201 09:00:18.547950 22809 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.62:46397 every 8 connection(s)
I20260201 09:00:18.551326 22810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 09:00:18.560019 22810 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1: Bootstrap starting.
I20260201 09:00:18.563763 22810 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1: Neither blocks nor log segments found. Creating new log.
I20260201 09:00:18.567041 22810 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1: No bootstrap required, opened a new log
I20260201 09:00:18.568703 22810 raft_consensus.cc:359] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e34920afe4604d4dac3bb771fbffbef1" member_type: VOTER }
I20260201 09:00:18.569070 22810 raft_consensus.cc:385] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 09:00:18.569231 22810 raft_consensus.cc:740] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34920afe4604d4dac3bb771fbffbef1, State: Initialized, Role: FOLLOWER
I20260201 09:00:18.569623 22810 consensus_queue.cc:260] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e34920afe4604d4dac3bb771fbffbef1" member_type: VOTER }
I20260201 09:00:18.569970 22810 raft_consensus.cc:399] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 09:00:18.570117 22810 raft_consensus.cc:493] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 09:00:18.570291 22810 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1 [term 0 FOLLOWER]: Advancing to term 1
I20260201 09:00:18.573726 22810 raft_consensus.cc:515] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e34920afe4604d4dac3bb771fbffbef1" member_type: VOTER }
I20260201 09:00:18.574126 22810 leader_election.cc:304] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e34920afe4604d4dac3bb771fbffbef1; no voters:
I20260201 09:00:18.575033 22810 leader_election.cc:290] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 09:00:18.575402 22813 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 09:00:18.576587 22813 raft_consensus.cc:697] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1 [term 1 LEADER]: Becoming Leader. State: Replica: e34920afe4604d4dac3bb771fbffbef1, State: Running, Role: LEADER
I20260201 09:00:18.577150 22813 consensus_queue.cc:237] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e34920afe4604d4dac3bb771fbffbef1" member_type: VOTER }
I20260201 09:00:18.577734 22810 sys_catalog.cc:565] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1 [sys.catalog]: configured and running, proceeding with master startup.
I20260201 09:00:18.581224 22814 sys_catalog.cc:455] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e34920afe4604d4dac3bb771fbffbef1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e34920afe4604d4dac3bb771fbffbef1" member_type: VOTER } }
I20260201 09:00:18.582077 22815 sys_catalog.cc:455] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e34920afe4604d4dac3bb771fbffbef1. Latest consensus state: current_term: 1 leader_uuid: "e34920afe4604d4dac3bb771fbffbef1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e34920afe4604d4dac3bb771fbffbef1" member_type: VOTER } }
I20260201 09:00:18.582444 22814 sys_catalog.cc:458] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1 [sys.catalog]: This master's current role is: LEADER
I20260201 09:00:18.582540 22815 sys_catalog.cc:458] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1 [sys.catalog]: This master's current role is: LEADER
I20260201 09:00:18.584187 22820 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 09:00:18.588440 22820 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 09:00:18.591315 18612 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260201 09:00:18.595726 22820 catalog_manager.cc:1357] Generated new cluster ID: e58611c7928b4f27bee2efe84dec0955
I20260201 09:00:18.595959 22820 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 09:00:18.614246 22820 catalog_manager.cc:1380] Generated new certificate authority record
I20260201 09:00:18.615244 22820 catalog_manager.cc:1514] Loading token signing keys...
I20260201 09:00:18.624418 22820 catalog_manager.cc:6027] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1: Generated new TSK 0
I20260201 09:00:18.624879 22820 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 09:00:18.657164 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 09:00:18.662273 22831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:18.663015 22832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:18.664113 18612 server_base.cc:1060] running on GCE node
W20260201 09:00:18.664378 22834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:18.665179 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 09:00:18.665378 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 09:00:18.665550 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936418665516 us; error 0 us; skew 500 ppm
I20260201 09:00:18.665989 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 09:00:18.667819 18612 webserver.cc:492] Webserver started at http://127.18.45.1:43365/ using document root <none> and password file <none>
I20260201 09:00:18.668256 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 09:00:18.668440 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 09:00:18.668682 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 09:00:18.669648 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/ts-0-root/instance:
uuid: "20addde74d974a79ae13ab86d3afa39f"
format_stamp: "Formatted at 2026-02-01 09:00:18 on dist-test-slave-zz6f"
I20260201 09:00:18.673223 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260201 09:00:18.676082 22839 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:18.676913 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260201 09:00:18.677143 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/ts-0-root
uuid: "20addde74d974a79ae13ab86d3afa39f"
format_stamp: "Formatted at 2026-02-01 09:00:18 on dist-test-slave-zz6f"
I20260201 09:00:18.677354 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 09:00:18.702648 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 09:00:18.703469 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 09:00:18.704881 18612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 09:00:18.706597 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 09:00:18.706758 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:18.706964 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 09:00:18.707090 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:18.740023 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.1:36417
I20260201 09:00:18.740118 22901 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.1:36417 every 8 connection(s)
I20260201 09:00:18.744091 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 09:00:18.750530 22906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:18.751117 22907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:18.753998 18612 server_base.cc:1060] running on GCE node
W20260201 09:00:18.753971 22910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:18.754808 22902 heartbeater.cc:344] Connected to a master server at 127.18.45.62:46397
I20260201 09:00:18.755144 22902 heartbeater.cc:461] Registering TS with master...
I20260201 09:00:18.755123 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 09:00:18.755510 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 09:00:18.755684 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936418755671 us; error 0 us; skew 500 ppm
I20260201 09:00:18.755965 22902 heartbeater.cc:507] Master 127.18.45.62:46397 requested a full tablet report, sending...
I20260201 09:00:18.756349 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 09:00:18.757952 22775 ts_manager.cc:194] Registered new tserver with Master: 20addde74d974a79ae13ab86d3afa39f (127.18.45.1:36417)
I20260201 09:00:18.758757 18612 webserver.cc:492] Webserver started at http://127.18.45.2:36943/ using document root <none> and password file <none>
I20260201 09:00:18.759333 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 09:00:18.759549 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 09:00:18.759805 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 09:00:18.760061 22775 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35024
I20260201 09:00:18.761049 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/ts-1-root/instance:
uuid: "1b283441b04b46a78b1403b590ce614a"
format_stamp: "Formatted at 2026-02-01 09:00:18 on dist-test-slave-zz6f"
I20260201 09:00:18.764952 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260201 09:00:18.767627 22914 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:18.768276 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260201 09:00:18.768537 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/ts-1-root
uuid: "1b283441b04b46a78b1403b590ce614a"
format_stamp: "Formatted at 2026-02-01 09:00:18 on dist-test-slave-zz6f"
I20260201 09:00:18.768774 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 09:00:18.800119 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 09:00:18.801172 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 09:00:18.802345 18612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 09:00:18.804177 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 09:00:18.804385 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:18.804610 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 09:00:18.804759 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:18.838263 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.2:38821
I20260201 09:00:18.838359 22976 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.2:38821 every 8 connection(s)
I20260201 09:00:18.842250 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 09:00:18.849036 22980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:18.849318 22981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:18.852181 22977 heartbeater.cc:344] Connected to a master server at 127.18.45.62:46397
W20260201 09:00:18.852345 22983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:18.852674 22977 heartbeater.cc:461] Registering TS with master...
I20260201 09:00:18.853081 18612 server_base.cc:1060] running on GCE node
I20260201 09:00:18.853577 22977 heartbeater.cc:507] Master 127.18.45.62:46397 requested a full tablet report, sending...
I20260201 09:00:18.853964 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 09:00:18.854197 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 09:00:18.854409 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936418854393 us; error 0 us; skew 500 ppm
I20260201 09:00:18.854888 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 09:00:18.855263 22775 ts_manager.cc:194] Registered new tserver with Master: 1b283441b04b46a78b1403b590ce614a (127.18.45.2:38821)
I20260201 09:00:18.856544 22775 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35030
I20260201 09:00:18.856914 18612 webserver.cc:492] Webserver started at http://127.18.45.3:43827/ using document root <none> and password file <none>
I20260201 09:00:18.857406 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 09:00:18.857625 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 09:00:18.857901 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 09:00:18.858858 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/ts-2-root/instance:
uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54"
format_stamp: "Formatted at 2026-02-01 09:00:18 on dist-test-slave-zz6f"
I20260201 09:00:18.862350 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260201 09:00:18.864884 22988 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:18.865586 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260201 09:00:18.865847 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/ts-2-root
uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54"
format_stamp: "Formatted at 2026-02-01 09:00:18 on dist-test-slave-zz6f"
I20260201 09:00:18.866093 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 09:00:18.889927 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 09:00:18.890882 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 09:00:18.892033 18612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 09:00:18.893834 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 09:00:18.894016 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:18.894263 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 09:00:18.894410 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:18.928712 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.3:39235
I20260201 09:00:18.928838 23050 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.3:39235 every 8 connection(s)
I20260201 09:00:18.932940 18612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 09:00:18.939450 23054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 09:00:18.941114 23055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:18.943706 18612 server_base.cc:1060] running on GCE node
W20260201 09:00:18.943949 23057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 09:00:18.944249 23051 heartbeater.cc:344] Connected to a master server at 127.18.45.62:46397
I20260201 09:00:18.944633 23051 heartbeater.cc:461] Registering TS with master...
I20260201 09:00:18.944836 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 09:00:18.945061 18612 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 09:00:18.945217 18612 hybrid_clock.cc:648] HybridClock initialized: now 1769936418945201 us; error 0 us; skew 500 ppm
I20260201 09:00:18.945293 23051 heartbeater.cc:507] Master 127.18.45.62:46397 requested a full tablet report, sending...
I20260201 09:00:18.945746 18612 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 09:00:18.946985 22775 ts_manager.cc:194] Registered new tserver with Master: 7021d813eb6d49aa9dc4eff7ee8f1a54 (127.18.45.3:39235)
I20260201 09:00:18.948086 18612 webserver.cc:492] Webserver started at http://127.18.45.4:41831/ using document root <none> and password file <none>
I20260201 09:00:18.948232 22775 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35032
I20260201 09:00:18.948540 18612 fs_manager.cc:362] Metadata directory not provided
I20260201 09:00:18.948750 18612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 09:00:18.949028 18612 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 09:00:18.949950 18612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/ts-3-root/instance:
uuid: "de9e888eb0ab491f97287aa4006d4282"
format_stamp: "Formatted at 2026-02-01 09:00:18 on dist-test-slave-zz6f"
I20260201 09:00:18.953529 18612 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260201 09:00:18.956265 23062 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:18.956941 18612 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260201 09:00:18.957188 18612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/ts-3-root
uuid: "de9e888eb0ab491f97287aa4006d4282"
format_stamp: "Formatted at 2026-02-01 09:00:18 on dist-test-slave-zz6f"
I20260201 09:00:18.957432 18612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 09:00:18.965674 18612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 09:00:18.966667 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 09:00:18.967896 18612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 09:00:18.969666 18612 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 09:00:18.969851 18612 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:18.970044 18612 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 09:00:18.970202 18612 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 09:00:19.004036 18612 rpc_server.cc:307] RPC server started. Bound to: 127.18.45.4:41165
I20260201 09:00:19.004161 23124 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.45.4:41165 every 8 connection(s)
I20260201 09:00:19.015723 23125 heartbeater.cc:344] Connected to a master server at 127.18.45.62:46397
I20260201 09:00:19.016032 23125 heartbeater.cc:461] Registering TS with master...
I20260201 09:00:19.016628 23125 heartbeater.cc:507] Master 127.18.45.62:46397 requested a full tablet report, sending...
I20260201 09:00:19.018078 22775 ts_manager.cc:194] Registered new tserver with Master: de9e888eb0ab491f97287aa4006d4282 (127.18.45.4:41165)
I20260201 09:00:19.018965 18612 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.012086814s
I20260201 09:00:19.019209 22775 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35046
I20260201 09:00:19.052171 22775 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35064:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260201 09:00:19.083827 23016 tablet_service.cc:1505] Processing CreateTablet for tablet 6165c546c1214ec193ce35d9da4abe6d (DEFAULT_TABLE table=test-workload [id=d4d26ceffbfb4ea3b7b729434701f011]), partition=RANGE (key) PARTITION UNBOUNDED
I20260201 09:00:19.084949 23016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6165c546c1214ec193ce35d9da4abe6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 09:00:19.085374 22867 tablet_service.cc:1505] Processing CreateTablet for tablet 6165c546c1214ec193ce35d9da4abe6d (DEFAULT_TABLE table=test-workload [id=d4d26ceffbfb4ea3b7b729434701f011]), partition=RANGE (key) PARTITION UNBOUNDED
I20260201 09:00:19.086457 22867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6165c546c1214ec193ce35d9da4abe6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 09:00:19.101698 23145 tablet_bootstrap.cc:492] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54: Bootstrap starting.
I20260201 09:00:19.102936 23146 tablet_bootstrap.cc:492] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f: Bootstrap starting.
I20260201 09:00:19.104310 22942 tablet_service.cc:1505] Processing CreateTablet for tablet 6165c546c1214ec193ce35d9da4abe6d (DEFAULT_TABLE table=test-workload [id=d4d26ceffbfb4ea3b7b729434701f011]), partition=RANGE (key) PARTITION UNBOUNDED
I20260201 09:00:19.105361 22942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6165c546c1214ec193ce35d9da4abe6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 09:00:19.107164 23145 tablet_bootstrap.cc:654] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54: Neither blocks nor log segments found. Creating new log.
I20260201 09:00:19.108551 23146 tablet_bootstrap.cc:654] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f: Neither blocks nor log segments found. Creating new log.
I20260201 09:00:19.110951 23145 tablet_bootstrap.cc:492] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54: No bootstrap required, opened a new log
I20260201 09:00:19.111366 23145 ts_tablet_manager.cc:1403] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.002s
I20260201 09:00:19.113101 23146 tablet_bootstrap.cc:492] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f: No bootstrap required, opened a new log
I20260201 09:00:19.113494 23146 ts_tablet_manager.cc:1403] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20260201 09:00:19.113212 23145 raft_consensus.cc:359] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 } } peers { permanent_uuid: "20addde74d974a79ae13ab86d3afa39f" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 36417 } } peers { permanent_uuid: "1b283441b04b46a78b1403b590ce614a" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38821 } }
I20260201 09:00:19.113914 23145 raft_consensus.cc:385] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 09:00:19.114145 23145 raft_consensus.cc:740] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7021d813eb6d49aa9dc4eff7ee8f1a54, State: Initialized, Role: FOLLOWER
I20260201 09:00:19.114665 23145 consensus_queue.cc:260] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 } } peers { permanent_uuid: "20addde74d974a79ae13ab86d3afa39f" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 36417 } } peers { permanent_uuid: "1b283441b04b46a78b1403b590ce614a" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38821 } }
I20260201 09:00:19.115896 23146 raft_consensus.cc:359] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 } } peers { permanent_uuid: "20addde74d974a79ae13ab86d3afa39f" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 36417 } } peers { permanent_uuid: "1b283441b04b46a78b1403b590ce614a" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38821 } }
I20260201 09:00:19.116418 23051 heartbeater.cc:499] Master 127.18.45.62:46397 was elected leader, sending a full tablet report...
I20260201 09:00:19.116555 23146 raft_consensus.cc:385] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 09:00:19.116940 23146 raft_consensus.cc:740] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20addde74d974a79ae13ab86d3afa39f, State: Initialized, Role: FOLLOWER
I20260201 09:00:19.116998 23145 ts_tablet_manager.cc:1434] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260201 09:00:19.117730 23146 consensus_queue.cc:260] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 } } peers { permanent_uuid: "20addde74d974a79ae13ab86d3afa39f" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 36417 } } peers { permanent_uuid: "1b283441b04b46a78b1403b590ce614a" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38821 } }
I20260201 09:00:19.120447 23146 ts_tablet_manager.cc:1434] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260201 09:00:19.120780 22902 heartbeater.cc:499] Master 127.18.45.62:46397 was elected leader, sending a full tablet report...
I20260201 09:00:19.122054 23151 tablet_bootstrap.cc:492] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a: Bootstrap starting.
I20260201 09:00:19.128618 23151 tablet_bootstrap.cc:654] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a: Neither blocks nor log segments found. Creating new log.
I20260201 09:00:19.132400 23151 tablet_bootstrap.cc:492] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a: No bootstrap required, opened a new log
I20260201 09:00:19.132905 23151 ts_tablet_manager.cc:1403] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a: Time spent bootstrapping tablet: real 0.011s user 0.011s sys 0.000s
I20260201 09:00:19.134793 23151 raft_consensus.cc:359] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 } } peers { permanent_uuid: "20addde74d974a79ae13ab86d3afa39f" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 36417 } } peers { permanent_uuid: "1b283441b04b46a78b1403b590ce614a" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38821 } }
I20260201 09:00:19.135272 23151 raft_consensus.cc:385] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 09:00:19.135492 23151 raft_consensus.cc:740] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b283441b04b46a78b1403b590ce614a, State: Initialized, Role: FOLLOWER
I20260201 09:00:19.136077 23151 consensus_queue.cc:260] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 } } peers { permanent_uuid: "20addde74d974a79ae13ab86d3afa39f" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 36417 } } peers { permanent_uuid: "1b283441b04b46a78b1403b590ce614a" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38821 } }
I20260201 09:00:19.138154 22977 heartbeater.cc:499] Master 127.18.45.62:46397 was elected leader, sending a full tablet report...
I20260201 09:00:19.138521 23151 ts_tablet_manager.cc:1434] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260201 09:00:19.286240 23150 raft_consensus.cc:493] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:19.286669 23150 raft_consensus.cc:515] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 } } peers { permanent_uuid: "20addde74d974a79ae13ab86d3afa39f" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 36417 } } peers { permanent_uuid: "1b283441b04b46a78b1403b590ce614a" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38821 } }
I20260201 09:00:19.288458 23150 leader_election.cc:290] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7021d813eb6d49aa9dc4eff7ee8f1a54 (127.18.45.3:39235), 1b283441b04b46a78b1403b590ce614a (127.18.45.2:38821)
I20260201 09:00:19.296731 23026 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6165c546c1214ec193ce35d9da4abe6d" candidate_uuid: "20addde74d974a79ae13ab86d3afa39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" is_pre_election: true
I20260201 09:00:19.297385 23026 raft_consensus.cc:2468] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20addde74d974a79ae13ab86d3afa39f in term 0.
I20260201 09:00:19.297581 22952 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6165c546c1214ec193ce35d9da4abe6d" candidate_uuid: "20addde74d974a79ae13ab86d3afa39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b283441b04b46a78b1403b590ce614a" is_pre_election: true
I20260201 09:00:19.298128 22952 raft_consensus.cc:2468] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20addde74d974a79ae13ab86d3afa39f in term 0.
I20260201 09:00:19.298290 22843 leader_election.cc:304] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20addde74d974a79ae13ab86d3afa39f, 7021d813eb6d49aa9dc4eff7ee8f1a54; no voters:
I20260201 09:00:19.299008 23150 raft_consensus.cc:2804] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 09:00:19.299290 23150 raft_consensus.cc:493] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:19.299578 23150 raft_consensus.cc:3060] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f [term 0 FOLLOWER]: Advancing to term 1
I20260201 09:00:19.303659 23150 raft_consensus.cc:515] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 } } peers { permanent_uuid: "20addde74d974a79ae13ab86d3afa39f" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 36417 } } peers { permanent_uuid: "1b283441b04b46a78b1403b590ce614a" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38821 } }
I20260201 09:00:19.304898 23150 leader_election.cc:290] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f [CANDIDATE]: Term 1 election: Requested vote from peers 7021d813eb6d49aa9dc4eff7ee8f1a54 (127.18.45.3:39235), 1b283441b04b46a78b1403b590ce614a (127.18.45.2:38821)
I20260201 09:00:19.305495 23026 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6165c546c1214ec193ce35d9da4abe6d" candidate_uuid: "20addde74d974a79ae13ab86d3afa39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54"
I20260201 09:00:19.305639 22952 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6165c546c1214ec193ce35d9da4abe6d" candidate_uuid: "20addde74d974a79ae13ab86d3afa39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b283441b04b46a78b1403b590ce614a"
I20260201 09:00:19.305864 23026 raft_consensus.cc:3060] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54 [term 0 FOLLOWER]: Advancing to term 1
I20260201 09:00:19.306089 22952 raft_consensus.cc:3060] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [term 0 FOLLOWER]: Advancing to term 1
I20260201 09:00:19.309880 23026 raft_consensus.cc:2468] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20addde74d974a79ae13ab86d3afa39f in term 1.
I20260201 09:00:19.310062 22952 raft_consensus.cc:2468] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20addde74d974a79ae13ab86d3afa39f in term 1.
I20260201 09:00:19.310683 22843 leader_election.cc:304] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20addde74d974a79ae13ab86d3afa39f, 7021d813eb6d49aa9dc4eff7ee8f1a54; no voters:
I20260201 09:00:19.311333 23150 raft_consensus.cc:2804] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 09:00:19.312027 23150 raft_consensus.cc:697] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f [term 1 LEADER]: Becoming Leader. State: Replica: 20addde74d974a79ae13ab86d3afa39f, State: Running, Role: LEADER
I20260201 09:00:19.312698 23150 consensus_queue.cc:237] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 } } peers { permanent_uuid: "20addde74d974a79ae13ab86d3afa39f" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 36417 } } peers { permanent_uuid: "1b283441b04b46a78b1403b590ce614a" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38821 } }
I20260201 09:00:19.318614 22775 catalog_manager.cc:5654] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f reported cstate change: term changed from 0 to 1, leader changed from <none> to 20addde74d974a79ae13ab86d3afa39f (127.18.45.1). New cstate: current_term: 1 leader_uuid: "20addde74d974a79ae13ab86d3afa39f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20addde74d974a79ae13ab86d3afa39f" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 36417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b283441b04b46a78b1403b590ce614a" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38821 } health_report { overall_health: UNKNOWN } } }
I20260201 09:00:19.591818 22942 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:19.593577 22867 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260201 09:00:19.597072 23016 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:19.602118 23090 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+--------------------+---------
e34920afe4604d4dac3bb771fbffbef1 | 127.18.45.62:46397 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
1b283441b04b46a78b1403b590ce614a | 127.18.45.2:38821 | HEALTHY | <none> | 0 | 0
20addde74d974a79ae13ab86d3afa39f | 127.18.45.1:36417 | HEALTHY | <none> | 1 | 0
7021d813eb6d49aa9dc4eff7ee8f1a54 | 127.18.45.3:39235 | HEALTHY | <none> | 0 | 0
de9e888eb0ab491f97287aa4006d4282 | 127.18.45.4:41165 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
Tablet 6165c546c1214ec193ce35d9da4abe6d of table 'test-workload' is conflicted: 2 replicas' active configs disagree with the leader master's
7021d813eb6d49aa9dc4eff7ee8f1a54 (127.18.45.3:39235): RUNNING
20addde74d974a79ae13ab86d3afa39f (127.18.45.1:36417): RUNNING [LEADER]
1b283441b04b46a78b1403b590ce614a (127.18.45.2:38821): RUNNING
All reported replicas are:
A = 7021d813eb6d49aa9dc4eff7ee8f1a54
B = 20addde74d974a79ae13ab86d3afa39f
C = 1b283441b04b46a78b1403b590ce614a
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
master | A B* C | | | Yes
A | A B C | 1 | -1 | Yes
B | A B* C | 1 | -1 | Yes
C | A B C | 1 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | CONSENSUS_MISMATCH | 1 | 0 | 0 | 0 | 1
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+-------------------+---------------
Small | de9e888eb0ab491f97287aa4006d4282 | 127.18.45.4:41165 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260201 09:00:19.827523 18612 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260201 09:00:19.872267 23188 consensus_queue.cc:1048] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b283441b04b46a78b1403b590ce614a" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 09:00:19.882968 23191 consensus_queue.cc:1048] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 09:00:20.021162 23125 heartbeater.cc:499] Master 127.18.45.62:46397 was elected leader, sending a full tablet report...
I20260201 09:00:20.166797 22867 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260201 09:00:20.175542 22942 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:20.176779 23090 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:20.179754 23016 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+--------------------+---------
e34920afe4604d4dac3bb771fbffbef1 | 127.18.45.62:46397 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
1b283441b04b46a78b1403b590ce614a | 127.18.45.2:38821 | HEALTHY | <none> | 0 | 0
20addde74d974a79ae13ab86d3afa39f | 127.18.45.1:36417 | HEALTHY | <none> | 1 | 0
7021d813eb6d49aa9dc4eff7ee8f1a54 | 127.18.45.3:39235 | HEALTHY | <none> | 0 | 0
de9e888eb0ab491f97287aa4006d4282 | 127.18.45.4:41165 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
test-workload | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+-------------------+---------------
Small | de9e888eb0ab491f97287aa4006d4282 | 127.18.45.4:41165 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260201 09:00:20.372402 18612 log_verifier.cc:126] Checking tablet 6165c546c1214ec193ce35d9da4abe6d
I20260201 09:00:20.425536 18612 log_verifier.cc:177] Verified matching terms for 1 ops in tablet 6165c546c1214ec193ce35d9da4abe6d
I20260201 09:00:20.425944 18612 tablet_replica.cc:333] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f: stopping tablet replica
I20260201 09:00:20.426332 18612 raft_consensus.cc:2243] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f [term 1 LEADER]: Raft consensus shutting down.
I20260201 09:00:20.426975 18612 raft_consensus.cc:2272] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:20.603955 22942 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:20.606115 22867 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:20.611284 23016 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:20.614177 23090 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+--------------------+---------
e34920afe4604d4dac3bb771fbffbef1 | 127.18.45.62:46397 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
1b283441b04b46a78b1403b590ce614a | 127.18.45.2:38821 | HEALTHY | <none> | 0 | 0
20addde74d974a79ae13ab86d3afa39f | 127.18.45.1:36417 | HEALTHY | <none> | 0 | 0
7021d813eb6d49aa9dc4eff7ee8f1a54 | 127.18.45.3:39235 | HEALTHY | <none> | 0 | 0
de9e888eb0ab491f97287aa4006d4282 | 127.18.45.4:41165 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
Tablet 6165c546c1214ec193ce35d9da4abe6d of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
7021d813eb6d49aa9dc4eff7ee8f1a54 (127.18.45.3:39235): RUNNING
20addde74d974a79ae13ab86d3afa39f (127.18.45.1:36417): not running [LEADER]
State: FAILED
Data state: TABLET_DATA_READY
Last status: IO error: INJECTED ERROR: tablet failed
1b283441b04b46a78b1403b590ce614a (127.18.45.2:38821): RUNNING
All reported replicas are:
A = 7021d813eb6d49aa9dc4eff7ee8f1a54
B = 20addde74d974a79ae13ab86d3afa39f
C = 1b283441b04b46a78b1403b590ce614a
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
master | A B* C | | | Yes
A | A B* C | 1 | -1 | Yes
B | [config not available] | | |
C | A B* C | 1 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | UNDER_REPLICATED | 1 | 0 | 0 | 1 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+-------------------+---------------
Small | de9e888eb0ab491f97287aa4006d4282 | 127.18.45.4:41165 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260201 09:00:20.806316 18612 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260201 09:00:21.159951 23016 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:21.161456 22867 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:21.162179 22942 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:21.166417 23090 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+--------------------+---------
e34920afe4604d4dac3bb771fbffbef1 | 127.18.45.62:46397 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
1b283441b04b46a78b1403b590ce614a | 127.18.45.2:38821 | HEALTHY | <none> | 0 | 0
20addde74d974a79ae13ab86d3afa39f | 127.18.45.1:36417 | HEALTHY | <none> | 0 | 0
7021d813eb6d49aa9dc4eff7ee8f1a54 | 127.18.45.3:39235 | HEALTHY | <none> | 0 | 0
de9e888eb0ab491f97287aa4006d4282 | 127.18.45.4:41165 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
Tablet 6165c546c1214ec193ce35d9da4abe6d of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
7021d813eb6d49aa9dc4eff7ee8f1a54 (127.18.45.3:39235): RUNNING
20addde74d974a79ae13ab86d3afa39f (127.18.45.1:36417): not running [LEADER]
State: FAILED
Data state: TABLET_DATA_READY
Last status: IO error: INJECTED ERROR: tablet failed
1b283441b04b46a78b1403b590ce614a (127.18.45.2:38821): RUNNING
All reported replicas are:
A = 7021d813eb6d49aa9dc4eff7ee8f1a54
B = 20addde74d974a79ae13ab86d3afa39f
C = 1b283441b04b46a78b1403b590ce614a
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
master | A B* C | | | Yes
A | A B* C | 1 | -1 | Yes
B | [config not available] | | |
C | A B* C | 1 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | UNDER_REPLICATED | 1 | 0 | 0 | 1 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+-------------------+---------------
Small | de9e888eb0ab491f97287aa4006d4282 | 127.18.45.4:41165 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260201 09:00:21.386833 18612 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260201 09:00:21.794716 22942 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:21.800630 22867 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:21.803737 23016 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:21.804473 23090 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:21.849499 23311 raft_consensus.cc:493] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20addde74d974a79ae13ab86d3afa39f)
I20260201 09:00:21.850044 23311 raft_consensus.cc:515] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 } } peers { permanent_uuid: "20addde74d974a79ae13ab86d3afa39f" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 36417 } } peers { permanent_uuid: "1b283441b04b46a78b1403b590ce614a" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38821 } }
I20260201 09:00:21.874465 23311 leader_election.cc:290] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7021d813eb6d49aa9dc4eff7ee8f1a54 (127.18.45.3:39235), 20addde74d974a79ae13ab86d3afa39f (127.18.45.1:36417)
I20260201 09:00:21.896908 23314 raft_consensus.cc:493] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20addde74d974a79ae13ab86d3afa39f)
I20260201 09:00:21.897538 23026 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6165c546c1214ec193ce35d9da4abe6d" candidate_uuid: "1b283441b04b46a78b1403b590ce614a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" is_pre_election: true
I20260201 09:00:21.898296 23314 raft_consensus.cc:515] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 } } peers { permanent_uuid: "20addde74d974a79ae13ab86d3afa39f" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 36417 } } peers { permanent_uuid: "1b283441b04b46a78b1403b590ce614a" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38821 } }
I20260201 09:00:21.899222 23026 raft_consensus.cc:2468] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b283441b04b46a78b1403b590ce614a in term 1.
I20260201 09:00:21.901618 22918 leader_election.cc:304] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b283441b04b46a78b1403b590ce614a, 7021d813eb6d49aa9dc4eff7ee8f1a54; no voters:
I20260201 09:00:21.902361 22877 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6165c546c1214ec193ce35d9da4abe6d" candidate_uuid: "1b283441b04b46a78b1403b590ce614a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20addde74d974a79ae13ab86d3afa39f" is_pre_election: true
I20260201 09:00:21.902552 23311 raft_consensus.cc:2804] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 09:00:21.903000 23311 raft_consensus.cc:493] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20addde74d974a79ae13ab86d3afa39f)
W20260201 09:00:21.903460 22917 leader_election.cc:343] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 20addde74d974a79ae13ab86d3afa39f (127.18.45.1:36417): Illegal state: cannot vote while shut down
I20260201 09:00:21.903365 23311 raft_consensus.cc:3060] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [term 1 FOLLOWER]: Advancing to term 2
I20260201 09:00:21.917562 23314 leader_election.cc:290] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20addde74d974a79ae13ab86d3afa39f (127.18.45.1:36417), 1b283441b04b46a78b1403b590ce614a (127.18.45.2:38821)
I20260201 09:00:21.923012 23311 raft_consensus.cc:515] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 } } peers { permanent_uuid: "20addde74d974a79ae13ab86d3afa39f" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 36417 } } peers { permanent_uuid: "1b283441b04b46a78b1403b590ce614a" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38821 } }
I20260201 09:00:21.925071 23311 leader_election.cc:290] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [CANDIDATE]: Term 2 election: Requested vote from peers 7021d813eb6d49aa9dc4eff7ee8f1a54 (127.18.45.3:39235), 20addde74d974a79ae13ab86d3afa39f (127.18.45.1:36417)
I20260201 09:00:21.926383 22877 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6165c546c1214ec193ce35d9da4abe6d" candidate_uuid: "1b283441b04b46a78b1403b590ce614a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20addde74d974a79ae13ab86d3afa39f"
I20260201 09:00:21.928236 23026 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6165c546c1214ec193ce35d9da4abe6d" candidate_uuid: "1b283441b04b46a78b1403b590ce614a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54"
I20260201 09:00:21.928748 23026 raft_consensus.cc:3060] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54 [term 1 FOLLOWER]: Advancing to term 2
W20260201 09:00:21.931380 22917 leader_election.cc:343] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 20addde74d974a79ae13ab86d3afa39f (127.18.45.1:36417): Illegal state: cannot vote while shut down
I20260201 09:00:21.939704 22877 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6165c546c1214ec193ce35d9da4abe6d" candidate_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20addde74d974a79ae13ab86d3afa39f" is_pre_election: true
W20260201 09:00:21.940940 22991 leader_election.cc:343] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 20addde74d974a79ae13ab86d3afa39f (127.18.45.1:36417): Illegal state: cannot vote while shut down
I20260201 09:00:21.943923 23026 raft_consensus.cc:2468] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b283441b04b46a78b1403b590ce614a in term 2.
I20260201 09:00:21.944917 22918 leader_election.cc:304] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b283441b04b46a78b1403b590ce614a, 7021d813eb6d49aa9dc4eff7ee8f1a54; no voters: 20addde74d974a79ae13ab86d3afa39f
I20260201 09:00:21.945608 23311 raft_consensus.cc:2804] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [term 2 FOLLOWER]: Leader election won for term 2
I20260201 09:00:21.949651 22952 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6165c546c1214ec193ce35d9da4abe6d" candidate_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b283441b04b46a78b1403b590ce614a" is_pre_election: true
I20260201 09:00:21.958819 23311 raft_consensus.cc:697] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [term 2 LEADER]: Becoming Leader. State: Replica: 1b283441b04b46a78b1403b590ce614a, State: Running, Role: LEADER
I20260201 09:00:21.959685 23311 consensus_queue.cc:237] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 } } peers { permanent_uuid: "20addde74d974a79ae13ab86d3afa39f" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 36417 } } peers { permanent_uuid: "1b283441b04b46a78b1403b590ce614a" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38821 } }
I20260201 09:00:21.972545 22990 leader_election.cc:304] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7021d813eb6d49aa9dc4eff7ee8f1a54; no voters: 1b283441b04b46a78b1403b590ce614a, 20addde74d974a79ae13ab86d3afa39f
I20260201 09:00:21.973709 23314 raft_consensus.cc:2749] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 09:00:21.974227 22775 catalog_manager.cc:5654] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a reported cstate change: term changed from 1 to 2, leader changed from 20addde74d974a79ae13ab86d3afa39f (127.18.45.1) to 1b283441b04b46a78b1403b590ce614a (127.18.45.2). New cstate: current_term: 2 leader_uuid: "1b283441b04b46a78b1403b590ce614a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20addde74d974a79ae13ab86d3afa39f" member_type: VOTER last_known_addr { host: "127.18.45.1" port: 36417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b283441b04b46a78b1403b590ce614a" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38821 } health_report { overall_health: HEALTHY } } }
Master Summary
UUID | Address | Status
----------------------------------+--------------------+---------
e34920afe4604d4dac3bb771fbffbef1 | 127.18.45.62:46397 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
1b283441b04b46a78b1403b590ce614a | 127.18.45.2:38821 | HEALTHY | <none> | 0 | 0
20addde74d974a79ae13ab86d3afa39f | 127.18.45.1:36417 | HEALTHY | <none> | 0 | 0
7021d813eb6d49aa9dc4eff7ee8f1a54 | 127.18.45.3:39235 | HEALTHY | <none> | 0 | 0
de9e888eb0ab491f97287aa4006d4282 | 127.18.45.4:41165 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
Tablet 6165c546c1214ec193ce35d9da4abe6d of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
7021d813eb6d49aa9dc4eff7ee8f1a54 (127.18.45.3:39235): RUNNING
20addde74d974a79ae13ab86d3afa39f (127.18.45.1:36417): not running [LEADER]
State: FAILED
Data state: TABLET_DATA_READY
Last status: IO error: INJECTED ERROR: tablet failed
1b283441b04b46a78b1403b590ce614a (127.18.45.2:38821): RUNNING
All reported replicas are:
A = 7021d813eb6d49aa9dc4eff7ee8f1a54
B = 20addde74d974a79ae13ab86d3afa39f
C = 1b283441b04b46a78b1403b590ce614a
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
master | A B* C | | | Yes
A | A B* C | 1 | -1 | Yes
B | [config not available] | | |
C | A B* C | 1 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | UNDER_REPLICATED | 1 | 0 | 0 | 1 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+-------------------+---------------
Small | de9e888eb0ab491f97287aa4006d4282 | 127.18.45.4:41165 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260201 09:00:22.074082 18612 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260201 09:00:22.351191 23026 raft_consensus.cc:1275] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54 [term 2 FOLLOWER]: Refusing update from remote peer 1b283441b04b46a78b1403b590ce614a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 09:00:22.352243 23311 consensus_queue.cc:1048] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 09:00:22.360476 22917 consensus_queue.cc:579] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [LEADER]: The tablet replica hosted on peer 20addde74d974a79ae13ab86d3afa39f has failed
W20260201 09:00:22.360914 22917 consensus_peers.cc:597] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a -> Peer 20addde74d974a79ae13ab86d3afa39f (127.18.45.1:36417): Couldn't send request to peer 20addde74d974a79ae13ab86d3afa39f. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: IO error: INJECTED ERROR: tablet failed. This is attempt 1: this message will repeat every 5th retry.
I20260201 09:00:22.369285 22952 consensus_queue.cc:237] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 } } peers { permanent_uuid: "1b283441b04b46a78b1403b590ce614a" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38821 } }
I20260201 09:00:22.372079 23026 raft_consensus.cc:1275] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54 [term 2 FOLLOWER]: Refusing update from remote peer 1b283441b04b46a78b1403b590ce614a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260201 09:00:22.372953 23317 consensus_queue.cc:1048] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 09:00:22.376760 23311 raft_consensus.cc:2955] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, VOTER 20addde74d974a79ae13ab86d3afa39f (127.18.45.1) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 } } peers { permanent_uuid: "1b283441b04b46a78b1403b590ce614a" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38821 } } }
I20260201 09:00:22.378010 23026 raft_consensus.cc:2955] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, VOTER 20addde74d974a79ae13ab86d3afa39f (127.18.45.1) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 } } peers { permanent_uuid: "1b283441b04b46a78b1403b590ce614a" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38821 } } }
I20260201 09:00:22.382893 22760 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 6165c546c1214ec193ce35d9da4abe6d with cas_config_opid_index -1: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 09:00:22.385458 22774 catalog_manager.cc:5654] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a reported cstate change: config changed from index -1 to 3, VOTER 20addde74d974a79ae13ab86d3afa39f (127.18.45.1) evicted. New cstate: current_term: 2 leader_uuid: "1b283441b04b46a78b1403b590ce614a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b283441b04b46a78b1403b590ce614a" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38821 } health_report { overall_health: HEALTHY } } }
I20260201 09:00:22.392995 22867 tablet_service.cc:1552] Processing DeleteTablet for tablet 6165c546c1214ec193ce35d9da4abe6d with delete_type TABLET_DATA_TOMBSTONED (TS 20addde74d974a79ae13ab86d3afa39f not found in new config with opid_index 3) from {username='slave'} at 127.0.0.1:39286
I20260201 09:00:22.394567 23326 ts_tablet_manager.cc:1916] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 09:00:22.397367 22952 consensus_queue.cc:237] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 } } peers { permanent_uuid: "1b283441b04b46a78b1403b590ce614a" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38821 } } peers { permanent_uuid: "de9e888eb0ab491f97287aa4006d4282" member_type: NON_VOTER last_known_addr { host: "127.18.45.4" port: 41165 } attrs { promote: true } }
I20260201 09:00:22.402571 23026 raft_consensus.cc:1275] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54 [term 2 FOLLOWER]: Refusing update from remote peer 1b283441b04b46a78b1403b590ce614a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260201 09:00:22.406121 23311 consensus_queue.cc:1048] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 09:00:22.408324 23326 ts_tablet_manager.cc:1929] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260201 09:00:22.408739 23326 log.cc:1199] T 6165c546c1214ec193ce35d9da4abe6d P 20addde74d974a79ae13ab86d3afa39f: Deleting WAL directory at /tmp/dist-test-tasktZVcpb/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1769936356186478-18612-0/minicluster-data/ts-0-root/wals/6165c546c1214ec193ce35d9da4abe6d
I20260201 09:00:22.410280 22761 catalog_manager.cc:4985] TS 20addde74d974a79ae13ab86d3afa39f (127.18.45.1:36417): tablet 6165c546c1214ec193ce35d9da4abe6d (table test-workload [id=d4d26ceffbfb4ea3b7b729434701f011]) successfully deleted
I20260201 09:00:22.412012 23317 raft_consensus.cc:2955] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, NON_VOTER de9e888eb0ab491f97287aa4006d4282 (127.18.45.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 } } peers { permanent_uuid: "1b283441b04b46a78b1403b590ce614a" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38821 } } peers { permanent_uuid: "de9e888eb0ab491f97287aa4006d4282" member_type: NON_VOTER last_known_addr { host: "127.18.45.4" port: 41165 } attrs { promote: true } } }
W20260201 09:00:22.416954 22916 consensus_peers.cc:597] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a -> Peer de9e888eb0ab491f97287aa4006d4282 (127.18.45.4:41165): Couldn't send request to peer de9e888eb0ab491f97287aa4006d4282. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6165c546c1214ec193ce35d9da4abe6d. This is attempt 1: this message will repeat every 5th retry.
I20260201 09:00:22.416450 23026 raft_consensus.cc:2955] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, NON_VOTER de9e888eb0ab491f97287aa4006d4282 (127.18.45.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 } } peers { permanent_uuid: "1b283441b04b46a78b1403b590ce614a" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38821 } } peers { permanent_uuid: "de9e888eb0ab491f97287aa4006d4282" member_type: NON_VOTER last_known_addr { host: "127.18.45.4" port: 41165 } attrs { promote: true } } }
I20260201 09:00:22.426638 22774 catalog_manager.cc:5654] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54 reported cstate change: config changed from index 3 to 4, NON_VOTER de9e888eb0ab491f97287aa4006d4282 (127.18.45.4) added. New cstate: current_term: 2 leader_uuid: "1b283441b04b46a78b1403b590ce614a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7021d813eb6d49aa9dc4eff7ee8f1a54" member_type: VOTER last_known_addr { host: "127.18.45.3" port: 39235 } } peers { permanent_uuid: "1b283441b04b46a78b1403b590ce614a" member_type: VOTER last_known_addr { host: "127.18.45.2" port: 38821 } } peers { permanent_uuid: "de9e888eb0ab491f97287aa4006d4282" member_type: NON_VOTER last_known_addr { host: "127.18.45.4" port: 41165 } attrs { promote: true } } }
I20260201 09:00:22.430233 22760 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 6165c546c1214ec193ce35d9da4abe6d with cas_config_opid_index 3: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260201 09:00:22.613557 22942 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260201 09:00:22.615140 22867 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:22.616601 23016 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 09:00:22.622422 23090 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+--------------------+---------
e34920afe4604d4dac3bb771fbffbef1 | 127.18.45.62:46397 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
1b283441b04b46a78b1403b590ce614a | 127.18.45.2:38821 | HEALTHY | <none> | 1 | 0
20addde74d974a79ae13ab86d3afa39f | 127.18.45.1:36417 | HEALTHY | <none> | 0 | 0
7021d813eb6d49aa9dc4eff7ee8f1a54 | 127.18.45.3:39235 | HEALTHY | <none> | 0 | 0
de9e888eb0ab491f97287aa4006d4282 | 127.18.45.4:41165 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
test-workload | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+-------------------+---------------
Small | 20addde74d974a79ae13ab86d3afa39f | 127.18.45.1:36417 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260201 09:00:22.837567 18612 log_verifier.cc:126] Checking tablet 6165c546c1214ec193ce35d9da4abe6d
I20260201 09:00:22.871937 18612 log_verifier.cc:177] Verified matching terms for 4 ops in tablet 6165c546c1214ec193ce35d9da4abe6d
I20260201 09:00:22.873920 18612 tablet_server.cc:178] TabletServer@127.18.45.1:0 shutting down...
I20260201 09:00:22.892279 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 09:00:22.908747 18612 tablet_server.cc:195] TabletServer@127.18.45.1:0 shutdown complete.
I20260201 09:00:22.916069 18612 tablet_server.cc:178] TabletServer@127.18.45.2:0 shutting down...
I20260201 09:00:22.932745 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 09:00:22.933362 18612 tablet_replica.cc:333] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a: stopping tablet replica
I20260201 09:00:22.933835 18612 raft_consensus.cc:2243] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [term 2 LEADER]: Raft consensus shutting down.
I20260201 09:00:22.934514 18612 raft_consensus.cc:2272] T 6165c546c1214ec193ce35d9da4abe6d P 1b283441b04b46a78b1403b590ce614a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:22.952535 18612 tablet_server.cc:195] TabletServer@127.18.45.2:0 shutdown complete.
I20260201 09:00:22.960238 18612 tablet_server.cc:178] TabletServer@127.18.45.3:0 shutting down...
I20260201 09:00:22.976029 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 09:00:22.976595 18612 tablet_replica.cc:333] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54: stopping tablet replica
I20260201 09:00:22.977078 18612 raft_consensus.cc:2243] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 09:00:22.977528 18612 raft_consensus.cc:2272] T 6165c546c1214ec193ce35d9da4abe6d P 7021d813eb6d49aa9dc4eff7ee8f1a54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:22.995282 18612 tablet_server.cc:195] TabletServer@127.18.45.3:0 shutdown complete.
I20260201 09:00:23.002346 18612 tablet_server.cc:178] TabletServer@127.18.45.4:0 shutting down...
I20260201 09:00:23.017508 18612 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 09:00:23.032063 18612 tablet_server.cc:195] TabletServer@127.18.45.4:0 shutdown complete.
I20260201 09:00:23.038303 18612 master.cc:561] Master@127.18.45.62:46397 shutting down...
I20260201 09:00:23.051288 18612 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1 [term 1 LEADER]: Raft consensus shutting down.
I20260201 09:00:23.051651 18612 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 09:00:23.051862 18612 tablet_replica.cc:333] T 00000000000000000000000000000000 P e34920afe4604d4dac3bb771fbffbef1: stopping tablet replica
I20260201 09:00:23.069268 18612 master.cc:583] Master@127.18.45.62:46397 shutdown complete.
[ OK ] FailedTabletsAreReplacedITest.OneReplica/1 (4610 ms)
[----------] 2 tests from FailedTabletsAreReplacedITest (9366 ms total)
[----------] Global test environment tear-down
[==========] 13 tests from 4 test suites ran. (66759 ms total)
[ PASSED ] 11 tests.
[ SKIPPED ] 1 test, listed below:
[ SKIPPED ] LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange
[ FAILED ] 1 test, listed below:
[ FAILED ] TsTabletManagerITest.TestTableStats
1 FAILED TEST
I20260201 09:00:23.100744 18612 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/client/meta_cache.cc:788: suppressed but not reported on 3 messages since previous log ~10 seconds ago
I20260201 09:00:23.101027 18612 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 33 messages since previous log ~14 seconds ago
I20260201 09:00:23.101161 18612 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 101 messages since previous log ~58 seconds ago
I20260201 09:00:23.101380 18612 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet.cc:2378: suppressed but not reported on 7 messages since previous log ~12 seconds ago