Note: This is test shard 1 of 6.
[==========] Running 7 tests from 6 test suites.
[----------] Global test environment set-up.
[----------] 2 tests from DynamicMultiMasterTest
[ RUN ] DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr
2026-08-07T18:13:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:13:43Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260807 18:13:43.151587 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.62:35343
--webserver_interface=127.19.201.62
--webserver_port=0
--builtin_ntp_servers=127.19.201.20:45621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_auto_join_cluster=false with env {}
W20260807 18:13:43.498880 20274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:13:43.499277 20274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:13:43.499424 20274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:13:43.506903 20274 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:13:43.507087 20274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:13:43.507185 20274 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:13:43.507289 20274 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:13:43.516913 20274 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:45621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_auto_join_cluster=false
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.62:35343
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.201.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
I20260807 18:13:43.518524 20274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:13:43.520604 20274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:13:43.539132 20279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:43.539074 20280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:43.539131 20283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:13:43.540498 20274 server_base.cc:1034] running on GCE node
I20260807 18:13:43.541440 20274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:13:43.542991 20274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:13:43.544225 20274 hybrid_clock.cc:648] HybridClock initialized: now 1786126423544167 us; error 82 us; skew 500 ppm
I20260807 18:13:43.544618 20274 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:13:43.551113 20274 webserver.cc:460] Webserver started at http://127.19.201.62:38625/ using document root <none> and password file <none>
I20260807 18:13:43.551905 20274 fs_manager.cc:359] Metadata directory not provided
I20260807 18:13:43.552057 20274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:13:43.552387 20274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:13:43.555328 20274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-0/data/instance:
uuid: "3e594a93281e4513ad3448710e4fa588"
format_stamp: "Formatted at 2026-08-07 18:13:43 on dist-test-slave-bw88"
I20260807 18:13:43.556227 20274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-0/wal/instance:
uuid: "3e594a93281e4513ad3448710e4fa588"
format_stamp: "Formatted at 2026-08-07 18:13:43 on dist-test-slave-bw88"
I20260807 18:13:43.562546 20274 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260807 18:13:43.566345 20290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:13:43.567754 20274 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260807 18:13:43.567955 20274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-0/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-0/wal
uuid: "3e594a93281e4513ad3448710e4fa588"
format_stamp: "Formatted at 2026-08-07 18:13:43 on dist-test-slave-bw88"
I20260807 18:13:43.568169 20274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:13:43.589722 20274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:13:43.590677 20274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:13:43.591039 20274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:13:43.611196 20274 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.62:35343
I20260807 18:13:43.611229 20361 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.62:35343 every 8 connection(s)
I20260807 18:13:43.612752 20274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
I20260807 18:13:43.616919 20362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:13:43.622947 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 20274
I20260807 18:13:43.623252 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-0/wal/instance
I20260807 18:13:43.629869 20362 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e594a93281e4513ad3448710e4fa588: Bootstrap starting.
I20260807 18:13:43.633924 20362 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e594a93281e4513ad3448710e4fa588: Neither blocks nor log segments found. Creating new log.
I20260807 18:13:43.635027 20362 log.cc:824] T 00000000000000000000000000000000 P 3e594a93281e4513ad3448710e4fa588: Log is configured to *not* fsync() on all Append() calls
I20260807 18:13:43.638104 20362 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e594a93281e4513ad3448710e4fa588: No bootstrap required, opened a new log
I20260807 18:13:43.648864 20362 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3e594a93281e4513ad3448710e4fa588 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e594a93281e4513ad3448710e4fa588" member_type: VOTER }
I20260807 18:13:43.649318 20362 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3e594a93281e4513ad3448710e4fa588 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:13:43.649515 20362 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3e594a93281e4513ad3448710e4fa588 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e594a93281e4513ad3448710e4fa588, State: Initialized, Role: FOLLOWER
I20260807 18:13:43.650177 20362 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e594a93281e4513ad3448710e4fa588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e594a93281e4513ad3448710e4fa588" member_type: VOTER }
I20260807 18:13:43.650441 20362 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3e594a93281e4513ad3448710e4fa588 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:13:43.650619 20362 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3e594a93281e4513ad3448710e4fa588 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:13:43.650828 20362 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3e594a93281e4513ad3448710e4fa588 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:13:43.654034 20362 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3e594a93281e4513ad3448710e4fa588 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e594a93281e4513ad3448710e4fa588" member_type: VOTER }
I20260807 18:13:43.654696 20362 leader_election.cc:302] T 00000000000000000000000000000000 P 3e594a93281e4513ad3448710e4fa588 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e594a93281e4513ad3448710e4fa588; no voters:
I20260807 18:13:43.655944 20362 leader_election.cc:288] T 00000000000000000000000000000000 P 3e594a93281e4513ad3448710e4fa588 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:13:43.656095 20369 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3e594a93281e4513ad3448710e4fa588 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:13:43.657685 20369 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3e594a93281e4513ad3448710e4fa588 [term 1 LEADER]: Becoming Leader. State: Replica: 3e594a93281e4513ad3448710e4fa588, State: Running, Role: LEADER
I20260807 18:13:43.658237 20369 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3e594a93281e4513ad3448710e4fa588 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e594a93281e4513ad3448710e4fa588" member_type: VOTER }
I20260807 18:13:43.658450 20362 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e594a93281e4513ad3448710e4fa588 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:13:43.662266 20370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e594a93281e4513ad3448710e4fa588 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3e594a93281e4513ad3448710e4fa588" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e594a93281e4513ad3448710e4fa588" member_type: VOTER } }
I20260807 18:13:43.662396 20371 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e594a93281e4513ad3448710e4fa588 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e594a93281e4513ad3448710e4fa588. Latest consensus state: current_term: 1 leader_uuid: "3e594a93281e4513ad3448710e4fa588" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e594a93281e4513ad3448710e4fa588" member_type: VOTER } }
I20260807 18:13:43.662715 20371 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e594a93281e4513ad3448710e4fa588 [sys.catalog]: This master's current role is: LEADER
I20260807 18:13:43.662714 20370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e594a93281e4513ad3448710e4fa588 [sys.catalog]: This master's current role is: LEADER
I20260807 18:13:43.664079 20379 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:13:43.669867 20379 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:13:43.679850 20379 catalog_manager.cc:1347] Generated new cluster ID: 9f61bca0673a4440a9b9a3746e780632
I20260807 18:13:43.679998 20379 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:13:43.689429 20379 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:13:43.691399 20379 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:13:43.701689 20379 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3e594a93281e4513ad3448710e4fa588: Generated new TSK 0
I20260807 18:13:43.702600 20379 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:13:43.714710 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.201.1:0
--local_ip_for_outbound_sockets=127.19.201.1
--webserver_interface=127.19.201.1
--webserver_port=0
--tserver_master_addrs=127.19.201.62:35343
--builtin_ntp_servers=127.19.201.20:45621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20260807 18:13:44.064711 20392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:13:44.065060 20392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:13:44.065239 20392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:13:44.072789 20392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:13:44.072985 20392 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.201.1
I20260807 18:13:44.082203 20392 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:45621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.201.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.201.1
--webserver_port=0
--tserver_master_addrs=127.19.201.62:35343
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.201.1
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
I20260807 18:13:44.083657 20392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:13:44.085628 20392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:13:44.099324 20399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:44.099367 20401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:44.099418 20403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:13:44.102905 20392 server_base.cc:1034] running on GCE node
I20260807 18:13:44.103586 20392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:13:44.104578 20392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:13:44.105839 20392 hybrid_clock.cc:648] HybridClock initialized: now 1786126424105759 us; error 46 us; skew 500 ppm
I20260807 18:13:44.106164 20392 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:13:44.108690 20392 webserver.cc:460] Webserver started at http://127.19.201.1:34971/ using document root <none> and password file <none>
I20260807 18:13:44.109493 20392 fs_manager.cc:359] Metadata directory not provided
I20260807 18:13:44.109658 20392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:13:44.109999 20392 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:13:44.112756 20392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/ts-0/data/instance:
uuid: "c3d193a62d0b4cdfb593425dd883adc7"
format_stamp: "Formatted at 2026-08-07 18:13:44 on dist-test-slave-bw88"
I20260807 18:13:44.113641 20392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/ts-0/wal/instance:
uuid: "c3d193a62d0b4cdfb593425dd883adc7"
format_stamp: "Formatted at 2026-08-07 18:13:44 on dist-test-slave-bw88"
I20260807 18:13:44.119086 20392 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 18:13:44.122687 20411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:13:44.124193 20392 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:13:44.124389 20392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/ts-0/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/ts-0/wal
uuid: "c3d193a62d0b4cdfb593425dd883adc7"
format_stamp: "Formatted at 2026-08-07 18:13:44 on dist-test-slave-bw88"
I20260807 18:13:44.124645 20392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:13:44.151261 20392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:13:44.152200 20392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:13:44.152573 20392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:13:44.153709 20392 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:13:44.155289 20392 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:13:44.155407 20392 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:13:44.155575 20392 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:13:44.155656 20392 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:13:44.192829 20392 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.1:44739
I20260807 18:13:44.192883 20566 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.1:44739 every 8 connection(s)
I20260807 18:13:44.194255 20392 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb
I20260807 18:13:44.197084 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 20392
I20260807 18:13:44.197305 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/ts-0/wal/instance
I20260807 18:13:44.209554 20568 heartbeater.cc:347] Connected to a master server at 127.19.201.62:35343
I20260807 18:13:44.209872 20568 heartbeater.cc:464] Registering TS with master...
I20260807 18:13:44.210637 20568 heartbeater.cc:511] Master 127.19.201.62:35343 requested a full tablet report, sending...
I20260807 18:13:44.212720 20315 ts_manager.cc:194] Registered new tserver with Master: c3d193a62d0b4cdfb593425dd883adc7 (127.19.201.1:44739)
I20260807 18:13:44.214474 20315 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.201.1:58139
I20260807 18:13:44.214614 20260 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20260807 18:13:44.218510 20260 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20260807 18:13:45.217659 20568 heartbeater.cc:503] Master 127.19.201.62:35343 was elected leader, sending a full tablet report...
E20260807 18:13:45.264065 20315 master_service.cc:308] Failed adding master 127.19.201.61:40233. Invalid argument: 'last_known_addr' field in single master Raft configuration not set. Please restart master with --master_addresses flag set to the single master which will populate the 'last_known_addr' field.
I20260807 18:13:45.378391 20260 dynamic_multi_master-test.cc:554] Add master stderr: W20260807 18:13:44.572459 20573 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:13:44.572793 20573 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:13:44.572917 20573 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:13:44.580320 20573 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:13:44.580440 20573 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:13:44.580487 20573 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:13:44.580542 20573 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 18:13:44.580621 20573 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
W20260807 18:13:44.951453 20588 logging.cc:291] disabling asynchronous logging adversely affects Kudu's performance
W20260807 18:13:44.958968 20588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:13:44.959180 20588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:13:44.959304 20588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:13:44.967536 20588 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:13:44.967689 20588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:13:44.967778 20588 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:13:44.967849 20588 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:13:44.978435 20588 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:45621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.201.62:35343,127.19.201.61:40233
--master_auto_join_cluster=false
--master_address_add_new_master=127.19.201.61:40233
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.61:40233
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.201.61
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_async=false
--log_filename=kudu
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
W20260807 18:13:44.978837 20588 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.19.201.62:35343,127.19.201.61:40233'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 18:13:44.980108 20588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:13:44.982147 20588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:13:44.995440 20596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:44.995474 20592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:44.995384 20594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:13:44.996704 20588 server_base.cc:1034] running on GCE node
I20260807 18:13:44.997582 20588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:13:44.999055 20588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:13:45.000329 20588 hybrid_clock.cc:648] HybridClock initialized: now 1786126425000258 us; error 34 us; skew 500 ppm
I20260807 18:13:45.000698 20588 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:13:45.003360 20588 webserver.cc:460] Webserver started at http://127.19.201.61:8051/ using document root <none> and password file <none>
I20260807 18:13:45.004119 20588 fs_manager.cc:359] Metadata directory not provided
I20260807 18:13:45.004290 20588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:13:45.004622 20588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:13:45.007711 20588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-1/data/instance:
uuid: "acef3dad8035407ea3c05b741f54fb52"
format_stamp: "Formatted at 2026-08-07 18:13:45 on dist-test-slave-bw88"
I20260807 18:13:45.008545 20588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-1/wal/instance:
uuid: "acef3dad8035407ea3c05b741f54fb52"
format_stamp: "Formatted at 2026-08-07 18:13:45 on dist-test-slave-bw88"
I20260807 18:13:45.014370 20588 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 18:13:45.018229 20605 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:13:45.019831 20588 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:13:45.020080 20588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-1/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-1/wal
uuid: "acef3dad8035407ea3c05b741f54fb52"
format_stamp: "Formatted at 2026-08-07 18:13:45 on dist-test-slave-bw88"
I20260807 18:13:45.020327 20588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:13:45.044790 20588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:13:45.045869 20588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:13:45.046237 20588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:13:45.069195 20588 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.61:40233
I20260807 18:13:45.069221 20669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.61:40233 every 8 connection(s)
I20260807 18:13:45.070885 20588 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb
I20260807 18:13:45.075316 20670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:13:45.081732 20670 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.62" port: 35343 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:13:45.101383 20670 sys_catalog.cc:422] member_type: NON_VOTER last_known_addr { host: "127.19.201.61" port: 40233 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:13:45.114463 20670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acef3dad8035407ea3c05b741f54fb52: Bootstrap starting.
I20260807 18:13:45.118001 20670 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P acef3dad8035407ea3c05b741f54fb52: Neither blocks nor log segments found. Creating new log.
I20260807 18:13:45.119148 20670 log.cc:824] T 00000000000000000000000000000000 P acef3dad8035407ea3c05b741f54fb52: Log is configured to *not* fsync() on all Append() calls
I20260807 18:13:45.121963 20670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acef3dad8035407ea3c05b741f54fb52: No bootstrap required, opened a new log
I20260807 18:13:45.130972 20670 raft_consensus.cc:348] T 00000000000000000000000000000000 P acef3dad8035407ea3c05b741f54fb52 [term 0 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e594a93281e4513ad3448710e4fa588" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 35343 } } peers { permanent_uuid: "acef3dad8035407ea3c05b741f54fb52" member_type: NON_VOTER last_known_addr { host: "127.19.201.61" port: 40233 } }
I20260807 18:13:45.131294 20670 raft_consensus.cc:374] T 00000000000000000000000000000000 P acef3dad8035407ea3c05b741f54fb52 [term 0 LEARNER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:13:45.131381 20670 raft_consensus.cc:729] T 00000000000000000000000000000000 P acef3dad8035407ea3c05b741f54fb52 [term 0 LEARNER]: Becoming Follower/Learner. State: Replica: acef3dad8035407ea3c05b741f54fb52, State: Initialized, Role: LEARNER
I20260807 18:13:45.131808 20670 consensus_queue.cc:260] T 00000000000000000000000000000000 P acef3dad8035407ea3c05b741f54fb52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e594a93281e4513ad3448710e4fa588" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 35343 } } peers { permanent_uuid: "acef3dad8035407ea3c05b741f54fb52" member_type: NON_VOTER last_known_addr { host: "127.19.201.61" port: 40233 } }
I20260807 18:13:45.132741 20679 sys_catalog.cc:455] T 00000000000000000000000000000000 P acef3dad8035407ea3c05b741f54fb52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e594a93281e4513ad3448710e4fa588" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 35343 } } peers { permanent_uuid: "acef3dad8035407ea3c05b741f54fb52" member_type: NON_VOTER last_known_addr { host: "127.19.201.61" port: 40233 } } }
I20260807 18:13:45.133206 20679 sys_catalog.cc:458] T 00000000000000000000000000000000 P acef3dad8035407ea3c05b741f54fb52 [sys.catalog]: This master's current role is: LEARNER
I20260807 18:13:45.134032 20670 sys_catalog.cc:564] T 00000000000000000000000000000000 P acef3dad8035407ea3c05b741f54fb52 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 18:13:45.150004 20699 catalog_manager.cc:1558] T 00000000000000000000000000000000 P acef3dad8035407ea3c05b741f54fb52: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:13:45.150180 20699 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Remote error: Invalid argument: 'last_known_addr' field in single master Raft configuration not set. Please restart master with --master_addresses flag set to the single master which will populate the 'last_known_addr' field.
I20260807 18:13:45.384449 20260 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskorkq8y/build/asan/bin/kudu pid 20392
I20260807 18:13:45.394284 20559 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 18:13:45.477891 20260 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskorkq8y/build/asan/bin/kudu with pid 20392
I20260807 18:13:45.504745 20260 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskorkq8y/build/asan/bin/kudu pid 20274
I20260807 18:13:45.506230 20356 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 18:13:45.609771 20260 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskorkq8y/build/asan/bin/kudu with pid 20274
2026-08-07T18:13:45Z chronyd exiting
[ OK ] DynamicMultiMasterTest.TestAddMasterWithNoLastKnownAddr (2546 ms)
[ RUN ] DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname
2026-08-07T18:13:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:13:45Z Disabled control of system clock
I20260807 18:13:45.686036 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.62:33803
--webserver_interface=127.19.201.62
--webserver_port=0
--builtin_ntp_servers=127.19.201.20:37181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.201.62:33803,127.19.201.61:34627
--master_auto_join_cluster=false with env {}
W20260807 18:13:46.057603 20720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:13:46.057919 20720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:13:46.058209 20720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:13:46.065876 20720 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:13:46.065992 20720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:13:46.066064 20720 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:13:46.066144 20720 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:13:46.075587 20720 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:37181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.201.62:33803,127.19.201.61:34627
--master_auto_join_cluster=false
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.62:33803
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.201.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
W20260807 18:13:46.076022 20720 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.19.201.62:33803,127.19.201.61:34627'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 18:13:46.077168 20720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:13:46.079180 20720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:13:46.091632 20730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:46.091591 20733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:46.091729 20729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:13:46.092890 20720 server_base.cc:1034] running on GCE node
I20260807 18:13:46.093834 20720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:13:46.095325 20720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:13:46.096578 20720 hybrid_clock.cc:648] HybridClock initialized: now 1786126426096522 us; error 50 us; skew 500 ppm
I20260807 18:13:46.096989 20720 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:13:46.099421 20720 webserver.cc:460] Webserver started at http://127.19.201.62:42289/ using document root <none> and password file <none>
I20260807 18:13:46.100211 20720 fs_manager.cc:359] Metadata directory not provided
I20260807 18:13:46.100358 20720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:13:46.100710 20720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:13:46.103657 20720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-0/data/instance:
uuid: "d3269e856b6742f1b24ee8c2eb45cf41"
format_stamp: "Formatted at 2026-08-07 18:13:46 on dist-test-slave-bw88"
I20260807 18:13:46.104523 20720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-0/wal/instance:
uuid: "d3269e856b6742f1b24ee8c2eb45cf41"
format_stamp: "Formatted at 2026-08-07 18:13:46 on dist-test-slave-bw88"
I20260807 18:13:46.110368 20720 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 18:13:46.114022 20739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:13:46.115478 20720 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:13:46.115688 20720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-0/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-0/wal
uuid: "d3269e856b6742f1b24ee8c2eb45cf41"
format_stamp: "Formatted at 2026-08-07 18:13:46 on dist-test-slave-bw88"
I20260807 18:13:46.115940 20720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:13:46.152336 20720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:13:46.153362 20720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:13:46.153702 20720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:13:46.176085 20720 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.62:33803
I20260807 18:13:46.176110 20811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.62:33803 every 8 connection(s)
I20260807 18:13:46.177760 20720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
I20260807 18:13:46.182338 20812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:13:46.185479 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 20720
I20260807 18:13:46.185724 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-0/wal/instance
I20260807 18:13:46.187423 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.61:34627
--webserver_interface=127.19.201.61
--webserver_port=0
--builtin_ntp_servers=127.19.201.20:37181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.201.62:33803,127.19.201.61:34627
--master_auto_join_cluster=false with env {}
I20260807 18:13:46.191422 20812 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33803 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:13:46.211658 20812 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.61" port: 34627 } has no permanent_uuid. Determining permanent_uuid...
W20260807 18:13:46.213219 20744 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.201.61:34627: connect: Connection refused (error 111)
W20260807 18:13:46.214866 20812 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:34627: Network error: Client connection negotiation failed: client connection to 127.19.201.61:34627: connect: Connection refused (error 111)
I20260807 18:13:46.264294 20812 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 34627 } attempt: 1
W20260807 18:13:46.266418 20812 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:34627: Network error: Client connection negotiation failed: client connection to 127.19.201.61:34627: connect: Connection refused (error 111)
I20260807 18:13:46.334734 20812 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 34627 } attempt: 2
W20260807 18:13:46.336951 20812 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:34627: Network error: Client connection negotiation failed: client connection to 127.19.201.61:34627: connect: Connection refused (error 111)
I20260807 18:13:46.428318 20812 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 34627 } attempt: 3
W20260807 18:13:46.430716 20812 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:34627: Network error: Client connection negotiation failed: client connection to 127.19.201.61:34627: connect: Connection refused (error 111)
W20260807 18:13:46.564080 20814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:13:46.564421 20814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:13:46.564574 20814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:13:46.572356 20814 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:13:46.572527 20814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:13:46.572655 20814 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:13:46.572770 20814 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:13:46.574029 20812 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 34627 } attempt: 4
W20260807 18:13:46.576303 20812 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:34627: Network error: Client connection negotiation failed: client connection to 127.19.201.61:34627: connect: Connection refused (error 111)
I20260807 18:13:46.583218 20814 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:37181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.201.62:33803,127.19.201.61:34627
--master_auto_join_cluster=false
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.61:34627
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.201.61
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
W20260807 18:13:46.583596 20814 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.19.201.62:33803,127.19.201.61:34627'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 18:13:46.584853 20814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:13:46.586845 20814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:13:46.599910 20825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:46.599910 20832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:46.599956 20829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:13:46.601547 20814 server_base.cc:1034] running on GCE node
I20260807 18:13:46.602391 20814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:13:46.604233 20814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:13:46.605468 20814 hybrid_clock.cc:648] HybridClock initialized: now 1786126426605403 us; error 67 us; skew 500 ppm
I20260807 18:13:46.605886 20814 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:13:46.608316 20814 webserver.cc:460] Webserver started at http://127.19.201.61:42073/ using document root <none> and password file <none>
I20260807 18:13:46.609112 20814 fs_manager.cc:359] Metadata directory not provided
I20260807 18:13:46.609257 20814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:13:46.609704 20814 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:13:46.612895 20814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-1/data/instance:
uuid: "840360abb88a4b3fa556b9b3d432a8aa"
format_stamp: "Formatted at 2026-08-07 18:13:46 on dist-test-slave-bw88"
I20260807 18:13:46.622625 20814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-1/wal/instance:
uuid: "840360abb88a4b3fa556b9b3d432a8aa"
format_stamp: "Formatted at 2026-08-07 18:13:46 on dist-test-slave-bw88"
I20260807 18:13:46.629172 20814 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.005s
I20260807 18:13:46.633265 20845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:13:46.635114 20814 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:13:46.635352 20814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-1/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-1/wal
uuid: "840360abb88a4b3fa556b9b3d432a8aa"
format_stamp: "Formatted at 2026-08-07 18:13:46 on dist-test-slave-bw88"
I20260807 18:13:46.635628 20814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:13:46.654050 20814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:13:46.655088 20814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:13:46.655426 20814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:13:46.677434 20916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.61:34627 every 8 connection(s)
I20260807 18:13:46.677430 20814 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.61:34627
I20260807 18:13:46.679085 20814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb
I20260807 18:13:46.682256 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 20814
I20260807 18:13:46.682428 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/master-1/wal/instance
I20260807 18:13:46.683485 20918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:13:46.693434 20918 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33803 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:13:46.706058 20918 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.61" port: 34627 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:13:46.715932 20918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa: Bootstrap starting.
I20260807 18:13:46.719636 20918 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa: Neither blocks nor log segments found. Creating new log.
I20260807 18:13:46.720804 20918 log.cc:824] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa: Log is configured to *not* fsync() on all Append() calls
I20260807 18:13:46.723873 20918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa: No bootstrap required, opened a new log
I20260807 18:13:46.731310 20918 raft_consensus.cc:348] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3269e856b6742f1b24ee8c2eb45cf41" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33803 } } peers { permanent_uuid: "840360abb88a4b3fa556b9b3d432a8aa" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 34627 } }
I20260807 18:13:46.731726 20918 raft_consensus.cc:374] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:13:46.731840 20918 raft_consensus.cc:729] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 840360abb88a4b3fa556b9b3d432a8aa, State: Initialized, Role: FOLLOWER
I20260807 18:13:46.732584 20918 consensus_queue.cc:260] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3269e856b6742f1b24ee8c2eb45cf41" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33803 } } peers { permanent_uuid: "840360abb88a4b3fa556b9b3d432a8aa" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 34627 } }
I20260807 18:13:46.733577 20926 sys_catalog.cc:455] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3269e856b6742f1b24ee8c2eb45cf41" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33803 } } peers { permanent_uuid: "840360abb88a4b3fa556b9b3d432a8aa" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 34627 } } }
I20260807 18:13:46.733940 20926 sys_catalog.cc:458] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:13:46.734766 20918 sys_catalog.cc:564] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [sys.catalog]: configured and running, proceeding with master startup.
W20260807 18:13:46.744319 20937 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:13:46.744472 20937 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:13:46.793239 20926 raft_consensus.cc:482] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:13:46.793780 20926 raft_consensus.cc:504] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3269e856b6742f1b24ee8c2eb45cf41" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33803 } } peers { permanent_uuid: "840360abb88a4b3fa556b9b3d432a8aa" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 34627 } }
I20260807 18:13:46.795241 20926 leader_election.cc:288] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3269e856b6742f1b24ee8c2eb45cf41 (127.19.201.62:33803)
I20260807 18:13:46.875603 20812 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 34627 } attempt: 5
I20260807 18:13:46.889810 20812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3269e856b6742f1b24ee8c2eb45cf41: Bootstrap starting.
I20260807 18:13:46.893707 20812 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3269e856b6742f1b24ee8c2eb45cf41: Neither blocks nor log segments found. Creating new log.
I20260807 18:13:46.895089 20812 log.cc:824] T 00000000000000000000000000000000 P d3269e856b6742f1b24ee8c2eb45cf41: Log is configured to *not* fsync() on all Append() calls
I20260807 18:13:46.898262 20812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3269e856b6742f1b24ee8c2eb45cf41: No bootstrap required, opened a new log
I20260807 18:13:46.907796 20812 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3269e856b6742f1b24ee8c2eb45cf41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3269e856b6742f1b24ee8c2eb45cf41" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33803 } } peers { permanent_uuid: "840360abb88a4b3fa556b9b3d432a8aa" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 34627 } }
W20260807 18:13:46.908034 20857 tablet.cc:2369] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:13:46.908224 20812 raft_consensus.cc:374] T 00000000000000000000000000000000 P d3269e856b6742f1b24ee8c2eb45cf41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:13:46.908342 20812 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3269e856b6742f1b24ee8c2eb45cf41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3269e856b6742f1b24ee8c2eb45cf41, State: Initialized, Role: FOLLOWER
I20260807 18:13:46.909056 20812 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3269e856b6742f1b24ee8c2eb45cf41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3269e856b6742f1b24ee8c2eb45cf41" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33803 } } peers { permanent_uuid: "840360abb88a4b3fa556b9b3d432a8aa" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 34627 } }
I20260807 18:13:46.910215 20940 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3269e856b6742f1b24ee8c2eb45cf41 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3269e856b6742f1b24ee8c2eb45cf41" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33803 } } peers { permanent_uuid: "840360abb88a4b3fa556b9b3d432a8aa" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 34627 } } }
I20260807 18:13:46.910676 20940 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3269e856b6742f1b24ee8c2eb45cf41 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:13:46.911703 20812 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3269e856b6742f1b24ee8c2eb45cf41 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:13:46.911818 20781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "840360abb88a4b3fa556b9b3d432a8aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3269e856b6742f1b24ee8c2eb45cf41" is_pre_election: true
I20260807 18:13:46.912470 20781 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d3269e856b6742f1b24ee8c2eb45cf41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 840360abb88a4b3fa556b9b3d432a8aa in term 0.
I20260807 18:13:46.913447 20848 leader_election.cc:302] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 840360abb88a4b3fa556b9b3d432a8aa, d3269e856b6742f1b24ee8c2eb45cf41; no voters:
I20260807 18:13:46.913978 20926 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:13:46.914135 20926 raft_consensus.cc:482] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:13:46.914269 20926 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [term 0 FOLLOWER]: Advancing to term 1
W20260807 18:13:46.925000 20959 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d3269e856b6742f1b24ee8c2eb45cf41: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:13:46.925156 20959 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:13:46.944252 20926 raft_consensus.cc:504] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3269e856b6742f1b24ee8c2eb45cf41" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33803 } } peers { permanent_uuid: "840360abb88a4b3fa556b9b3d432a8aa" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 34627 } }
I20260807 18:13:46.945055 20926 leader_election.cc:288] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [CANDIDATE]: Term 1 election: Requested vote from peers d3269e856b6742f1b24ee8c2eb45cf41 (127.19.201.62:33803)
I20260807 18:13:46.945904 20781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "840360abb88a4b3fa556b9b3d432a8aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3269e856b6742f1b24ee8c2eb45cf41"
I20260807 18:13:46.946167 20781 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3269e856b6742f1b24ee8c2eb45cf41 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:13:46.949709 20781 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d3269e856b6742f1b24ee8c2eb45cf41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 840360abb88a4b3fa556b9b3d432a8aa in term 1.
I20260807 18:13:46.950436 20848 leader_election.cc:302] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 840360abb88a4b3fa556b9b3d432a8aa, d3269e856b6742f1b24ee8c2eb45cf41; no voters:
I20260807 18:13:46.951061 20926 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:13:46.952795 20926 raft_consensus.cc:686] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [term 1 LEADER]: Becoming Leader. State: Replica: 840360abb88a4b3fa556b9b3d432a8aa, State: Running, Role: LEADER
I20260807 18:13:46.953568 20926 consensus_queue.cc:237] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3269e856b6742f1b24ee8c2eb45cf41" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33803 } } peers { permanent_uuid: "840360abb88a4b3fa556b9b3d432a8aa" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 34627 } }
I20260807 18:13:46.957118 20967 sys_catalog.cc:455] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 840360abb88a4b3fa556b9b3d432a8aa. Latest consensus state: current_term: 1 leader_uuid: "840360abb88a4b3fa556b9b3d432a8aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3269e856b6742f1b24ee8c2eb45cf41" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33803 } } peers { permanent_uuid: "840360abb88a4b3fa556b9b3d432a8aa" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 34627 } } }
I20260807 18:13:46.957602 20967 sys_catalog.cc:458] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [sys.catalog]: This master's current role is: LEADER
I20260807 18:13:46.959664 20969 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:13:46.961948 20969 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:13:46.971714 20781 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d3269e856b6742f1b24ee8c2eb45cf41 [term 1 FOLLOWER]: Refusing update from remote peer 840360abb88a4b3fa556b9b3d432a8aa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:13:46.972911 20967 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3269e856b6742f1b24ee8c2eb45cf41" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:13:46.983789 20940 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3269e856b6742f1b24ee8c2eb45cf41 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 840360abb88a4b3fa556b9b3d432a8aa. Latest consensus state: current_term: 1 leader_uuid: "840360abb88a4b3fa556b9b3d432a8aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3269e856b6742f1b24ee8c2eb45cf41" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33803 } } peers { permanent_uuid: "840360abb88a4b3fa556b9b3d432a8aa" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 34627 } } }
I20260807 18:13:46.984094 20940 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3269e856b6742f1b24ee8c2eb45cf41 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:13:46.991312 20970 mvcc.cc:205] Tried to move back new op lower bound from 7315973844863873024 to 7315973844806094848. Current Snapshot: MvccSnapshot[applied={T|T < 7315973844863873024}]
I20260807 18:13:46.997915 20967 sys_catalog.cc:455] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "840360abb88a4b3fa556b9b3d432a8aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3269e856b6742f1b24ee8c2eb45cf41" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33803 } } peers { permanent_uuid: "840360abb88a4b3fa556b9b3d432a8aa" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 34627 } } }
I20260807 18:13:46.998211 20967 sys_catalog.cc:458] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa [sys.catalog]: This master's current role is: LEADER
I20260807 18:13:46.999035 20940 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3269e856b6742f1b24ee8c2eb45cf41 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "840360abb88a4b3fa556b9b3d432a8aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3269e856b6742f1b24ee8c2eb45cf41" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33803 } } peers { permanent_uuid: "840360abb88a4b3fa556b9b3d432a8aa" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 34627 } } }
I20260807 18:13:46.999323 20940 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3269e856b6742f1b24ee8c2eb45cf41 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:13:47.000540 20969 catalog_manager.cc:1347] Generated new cluster ID: 0d624aa3dabd44639619e8e8d2ac4d1d
I20260807 18:13:47.000660 20969 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:13:47.062841 20969 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:13:47.064338 20969 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:13:47.083410 20969 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 840360abb88a4b3fa556b9b3d432a8aa: Generated new TSK 0
I20260807 18:13:47.084471 20969 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:13:47.097328 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.201.1:0
--local_ip_for_outbound_sockets=127.19.201.1
--webserver_interface=127.19.201.1
--webserver_port=0
--tserver_master_addrs=127.19.201.62:33803,127.19.201.61:34627
--builtin_ntp_servers=127.19.201.20:37181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20260807 18:13:47.485899 20977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:13:47.486264 20977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:13:47.486449 20977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:13:47.493934 20977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:13:47.494156 20977 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.201.1
I20260807 18:13:47.503476 20977 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:37181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.201.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.201.1
--webserver_port=0
--tserver_master_addrs=127.19.201.62:33803,127.19.201.61:34627
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.201.1
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
I20260807 18:13:47.504921 20977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:13:47.507061 20977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:13:47.521684 20989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:47.521736 20985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:47.521641 20986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:13:47.526854 20977 server_base.cc:1034] running on GCE node
I20260807 18:13:47.527522 20977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:13:47.528470 20977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:13:47.529696 20977 hybrid_clock.cc:648] HybridClock initialized: now 1786126427529627 us; error 34 us; skew 500 ppm
I20260807 18:13:47.530023 20977 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:13:47.532302 20977 webserver.cc:460] Webserver started at http://127.19.201.1:44161/ using document root <none> and password file <none>
I20260807 18:13:47.532999 20977 fs_manager.cc:359] Metadata directory not provided
I20260807 18:13:47.533152 20977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:13:47.533546 20977 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:13:47.536530 20977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/ts-0/data/instance:
uuid: "e7a03ae676eb4c5bb573f8c4803685e2"
format_stamp: "Formatted at 2026-08-07 18:13:47 on dist-test-slave-bw88"
I20260807 18:13:47.537300 20977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/ts-0/wal/instance:
uuid: "e7a03ae676eb4c5bb573f8c4803685e2"
format_stamp: "Formatted at 2026-08-07 18:13:47 on dist-test-slave-bw88"
I20260807 18:13:47.542850 20977 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260807 18:13:47.546823 20998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:13:47.548208 20977 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 18:13:47.548380 20977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/ts-0/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/ts-0/wal
uuid: "e7a03ae676eb4c5bb573f8c4803685e2"
format_stamp: "Formatted at 2026-08-07 18:13:47 on dist-test-slave-bw88"
I20260807 18:13:47.548573 20977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:13:47.568228 20977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:13:47.569168 20977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:13:47.569571 20977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:13:47.570626 20977 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:13:47.572211 20977 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:13:47.572289 20977 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:13:47.572376 20977 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:13:47.572424 20977 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:13:47.607427 20977 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.1:45969
I20260807 18:13:47.607470 21154 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.1:45969 every 8 connection(s)
I20260807 18:13:47.608842 20977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb
I20260807 18:13:47.610944 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 20977
I20260807 18:13:47.611160 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname.1786126423027121-20260-0/minicluster-data/ts-0/wal/instance
I20260807 18:13:47.627610 21156 heartbeater.cc:347] Connected to a master server at 127.19.201.61:34627
I20260807 18:13:47.627645 21159 heartbeater.cc:347] Connected to a master server at 127.19.201.62:33803
I20260807 18:13:47.627977 21156 heartbeater.cc:464] Registering TS with master...
I20260807 18:13:47.627974 21159 heartbeater.cc:464] Registering TS with master...
I20260807 18:13:47.628926 21156 heartbeater.cc:511] Master 127.19.201.61:34627 requested a full tablet report, sending...
I20260807 18:13:47.628947 21159 heartbeater.cc:511] Master 127.19.201.62:33803 requested a full tablet report, sending...
I20260807 18:13:47.631208 20871 ts_manager.cc:194] Registered new tserver with Master: e7a03ae676eb4c5bb573f8c4803685e2 (127.19.201.1:45969)
I20260807 18:13:47.631276 20766 ts_manager.cc:194] Registered new tserver with Master: e7a03ae676eb4c5bb573f8c4803685e2 (127.19.201.1:45969)
I20260807 18:13:47.633090 20871 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.201.1:45501
I20260807 18:13:47.635780 20260 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20260807 18:13:47.641317 20260 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20260807 18:13:47.927325 20959 catalog_manager.cc:1259] Loaded cluster ID: 0d624aa3dabd44639619e8e8d2ac4d1d
I20260807 18:13:47.927431 20959 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d3269e856b6742f1b24ee8c2eb45cf41: loading cluster ID for follower catalog manager: success
I20260807 18:13:47.930291 20959 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d3269e856b6742f1b24ee8c2eb45cf41: acquiring CA information for follower catalog manager: success
I20260807 18:13:47.932246 20959 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d3269e856b6742f1b24ee8c2eb45cf41: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
E20260807 18:13:48.476874 20871 master_service.cc:344] Failed removing master non-existent-path.local:7051. Not found: Master non-existent-path.local:7051 not found
I20260807 18:13:48.568635 20260 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskorkq8y/build/asan/bin/kudu pid 20977
I20260807 18:13:48.581753 21149 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 18:13:48.664078 21156 heartbeater.cc:503] Master 127.19.201.61:34627 was elected leader, sending a full tablet report...
I20260807 18:13:48.665647 20260 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskorkq8y/build/asan/bin/kudu with pid 20977
W20260807 18:13:48.692323 20743 connection.cc:535] server connection from 127.19.201.1:42619 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 18:13:48.692772 20260 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskorkq8y/build/asan/bin/kudu pid 20720
I20260807 18:13:48.694043 20807 generic_service.cc:196] Checking for leaks (request via RPC)
W20260807 18:13:48.692323 20846 connection.cc:535] server connection from 127.19.201.1:45501 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 18:13:48.798638 20260 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskorkq8y/build/asan/bin/kudu with pid 20720
I20260807 18:13:48.825645 20260 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskorkq8y/build/asan/bin/kudu pid 20814
I20260807 18:13:48.826848 20911 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 18:13:48.931026 20260 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskorkq8y/build/asan/bin/kudu with pid 20814
2026-08-07T18:13:48Z chronyd exiting
[ OK ] DynamicMultiMasterTest.TestRemoveMasterMissingAndIncorrectHostname (3319 ms)
[----------] 2 tests from DynamicMultiMasterTest (5866 ms total)
[----------] 1 test from AutoAddMasterTest
[ RUN ] AutoAddMasterTest.TestFailTabletCopy
2026-08-07T18:13:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:13:48Z Disabled control of system clock
I20260807 18:13:49.005563 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.62:36601
--webserver_interface=127.19.201.62
--webserver_port=0
--builtin_ntp_servers=127.19.201.20:33403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.201.62:36601,127.19.201.61:43333 with env {}
W20260807 18:13:49.350735 21203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:13:49.351044 21203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:13:49.351123 21203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:13:49.358430 21203 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:13:49.358551 21203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:13:49.358595 21203 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:13:49.358649 21203 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:13:49.368045 21203 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:33403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.201.62:36601,127.19.201.61:43333
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.62:36601
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.201.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
W20260807 18:13:49.368392 21203 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.19.201.62:36601,127.19.201.61:43333'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 18:13:49.369545 21203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:13:49.371460 21203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:13:49.383737 21210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:49.383773 21214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:49.383809 21212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:13:49.385027 21203 server_base.cc:1034] running on GCE node
I20260807 18:13:49.385958 21203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:13:49.387521 21203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:13:49.388762 21203 hybrid_clock.cc:648] HybridClock initialized: now 1786126429388686 us; error 66 us; skew 500 ppm
I20260807 18:13:49.389168 21203 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:13:49.391631 21203 webserver.cc:460] Webserver started at http://127.19.201.62:41537/ using document root <none> and password file <none>
I20260807 18:13:49.392403 21203 fs_manager.cc:359] Metadata directory not provided
I20260807 18:13:49.392501 21203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:13:49.392861 21203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:13:49.395776 21203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-0/data/instance:
uuid: "17c33b96ad82442794bbe16c2faf9e28"
format_stamp: "Formatted at 2026-08-07 18:13:49 on dist-test-slave-bw88"
I20260807 18:13:49.396615 21203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-0/wal/instance:
uuid: "17c33b96ad82442794bbe16c2faf9e28"
format_stamp: "Formatted at 2026-08-07 18:13:49 on dist-test-slave-bw88"
I20260807 18:13:49.402609 21203 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260807 18:13:49.406467 21220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:13:49.407982 21203 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 18:13:49.408192 21203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-0/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-0/wal
uuid: "17c33b96ad82442794bbe16c2faf9e28"
format_stamp: "Formatted at 2026-08-07 18:13:49 on dist-test-slave-bw88"
I20260807 18:13:49.408438 21203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:13:49.453732 21203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:13:49.454701 21203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:13:49.455034 21203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:13:49.474207 21203 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.62:36601
I20260807 18:13:49.474227 21291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.62:36601 every 8 connection(s)
I20260807 18:13:49.475669 21203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
I20260807 18:13:49.478988 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 21203
I20260807 18:13:49.479208 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-0/wal/instance
I20260807 18:13:49.479884 21293 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:13:49.480464 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.61:43333
--webserver_interface=127.19.201.61
--webserver_port=0
--builtin_ntp_servers=127.19.201.20:33403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.201.62:36601,127.19.201.61:43333 with env {}
I20260807 18:13:49.486307 21293 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:13:49.509959 21293 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } has no permanent_uuid. Determining permanent_uuid...
W20260807 18:13:49.511258 21222 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.201.61:43333: connect: Connection refused (error 111)
W20260807 18:13:49.513036 21293 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:43333: Network error: Client connection negotiation failed: client connection to 127.19.201.61:43333: connect: Connection refused (error 111)
I20260807 18:13:49.562469 21293 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } attempt: 1
W20260807 18:13:49.564834 21293 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:43333: Network error: Client connection negotiation failed: client connection to 127.19.201.61:43333: connect: Connection refused (error 111)
I20260807 18:13:49.633138 21293 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } attempt: 2
W20260807 18:13:49.635293 21293 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:43333: Network error: Client connection negotiation failed: client connection to 127.19.201.61:43333: connect: Connection refused (error 111)
I20260807 18:13:49.726598 21293 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } attempt: 3
W20260807 18:13:49.728843 21293 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:43333: Network error: Client connection negotiation failed: client connection to 127.19.201.61:43333: connect: Connection refused (error 111)
W20260807 18:13:49.830029 21296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:13:49.830353 21296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:13:49.830451 21296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:13:49.837927 21296 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:13:49.838053 21296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:13:49.838097 21296 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:13:49.838147 21296 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:13:49.847613 21296 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:33403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.201.62:36601,127.19.201.61:43333
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.61:43333
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.201.61
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
W20260807 18:13:49.847990 21296 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.19.201.62:36601,127.19.201.61:43333'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 18:13:49.849138 21296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:13:49.851024 21296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:13:49.863729 21309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:49.863648 21312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:49.863850 21308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:13:49.865087 21296 server_base.cc:1034] running on GCE node
I20260807 18:13:49.866065 21296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:13:49.867699 21296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:13:49.868949 21296 hybrid_clock.cc:648] HybridClock initialized: now 1786126429868899 us; error 59 us; skew 500 ppm
I20260807 18:13:49.869503 21296 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:13:49.872215 21296 webserver.cc:460] Webserver started at http://127.19.201.61:32903/ using document root <none> and password file <none>
I20260807 18:13:49.872143 21293 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } attempt: 4
I20260807 18:13:49.873238 21296 fs_manager.cc:359] Metadata directory not provided
I20260807 18:13:49.873399 21296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:13:49.873795 21296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
W20260807 18:13:49.874588 21293 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:43333: Network error: Client connection negotiation failed: client connection to 127.19.201.61:43333: connect: Connection refused (error 111)
I20260807 18:13:49.876689 21296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-1/data/instance:
uuid: "dcd3676c985c41b0beece0337769a738"
format_stamp: "Formatted at 2026-08-07 18:13:49 on dist-test-slave-bw88"
I20260807 18:13:49.877576 21296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-1/wal/instance:
uuid: "dcd3676c985c41b0beece0337769a738"
format_stamp: "Formatted at 2026-08-07 18:13:49 on dist-test-slave-bw88"
I20260807 18:13:49.883170 21296 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 18:13:49.887271 21319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:13:49.888792 21296 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 18:13:49.888994 21296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-1/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-1/wal
uuid: "dcd3676c985c41b0beece0337769a738"
format_stamp: "Formatted at 2026-08-07 18:13:49 on dist-test-slave-bw88"
I20260807 18:13:49.889245 21296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:13:49.919237 21296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:13:49.920228 21296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:13:49.920575 21296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:13:49.940547 21296 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.61:43333
I20260807 18:13:49.940567 21389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.61:43333 every 8 connection(s)
I20260807 18:13:49.942056 21296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb
I20260807 18:13:49.945523 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 21296
I20260807 18:13:49.945717 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-1/wal/instance
I20260807 18:13:49.946287 21390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:13:49.954778 21390 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:13:49.967736 21390 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:13:49.979007 21390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738: Bootstrap starting.
I20260807 18:13:49.982379 21390 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738: Neither blocks nor log segments found. Creating new log.
I20260807 18:13:49.983453 21390 log.cc:824] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738: Log is configured to *not* fsync() on all Append() calls
I20260807 18:13:49.986418 21390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738: No bootstrap required, opened a new log
I20260807 18:13:49.996171 21390 raft_consensus.cc:348] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } }
I20260807 18:13:49.996577 21390 raft_consensus.cc:374] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:13:49.996699 21390 raft_consensus.cc:729] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcd3676c985c41b0beece0337769a738, State: Initialized, Role: FOLLOWER
I20260807 18:13:49.997328 21390 consensus_queue.cc:260] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } }
I20260807 18:13:49.998297 21396 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } }
I20260807 18:13:49.998589 21396 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:13:49.999441 21390 sys_catalog.cc:564] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 18:13:50.009063 21411 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:13:50.009223 21411 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:13:50.006886 21296 master_runner.cc:186] Error getting master registration for 127.19.201.62:36601: OK, instance_id { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" instance_seqno: 1786126429468778 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 18:13:50.018491 21296 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 18:13:50.047380 21396 raft_consensus.cc:482] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:13:50.047748 21396 raft_consensus.cc:504] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } }
I20260807 18:13:50.049449 21396 leader_election.cc:288] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17c33b96ad82442794bbe16c2faf9e28 (127.19.201.62:36601)
W20260807 18:13:50.173058 21328 tablet.cc:2369] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:13:50.173840 21293 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } attempt: 5
I20260807 18:13:50.187727 21293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28: Bootstrap starting.
I20260807 18:13:50.192170 21293 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28: Neither blocks nor log segments found. Creating new log.
I20260807 18:13:50.193670 21293 log.cc:824] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28: Log is configured to *not* fsync() on all Append() calls
I20260807 18:13:50.197629 21293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28: No bootstrap required, opened a new log
I20260807 18:13:50.209147 21293 raft_consensus.cc:348] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } }
I20260807 18:13:50.209596 21293 raft_consensus.cc:374] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:13:50.209707 21293 raft_consensus.cc:729] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17c33b96ad82442794bbe16c2faf9e28, State: Initialized, Role: FOLLOWER
I20260807 18:13:50.210433 21293 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } }
I20260807 18:13:50.211500 21416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } }
I20260807 18:13:50.211949 21416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:13:50.212980 21293 sys_catalog.cc:564] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:13:50.213048 21262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dcd3676c985c41b0beece0337769a738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17c33b96ad82442794bbe16c2faf9e28" is_pre_election: true
I20260807 18:13:50.213790 21262 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcd3676c985c41b0beece0337769a738 in term 0.
I20260807 18:13:50.214607 21326 leader_election.cc:302] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 17c33b96ad82442794bbe16c2faf9e28, dcd3676c985c41b0beece0337769a738; no voters:
I20260807 18:13:50.215139 21396 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:13:50.215322 21396 raft_consensus.cc:482] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:13:50.215479 21396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:13:50.218426 21396 raft_consensus.cc:504] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } }
I20260807 18:13:50.219595 21262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dcd3676c985c41b0beece0337769a738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17c33b96ad82442794bbe16c2faf9e28"
I20260807 18:13:50.219810 21262 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:13:50.221618 21396 leader_election.cc:288] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [CANDIDATE]: Term 1 election: Requested vote from peers 17c33b96ad82442794bbe16c2faf9e28 (127.19.201.62:36601)
I20260807 18:13:50.222669 21262 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcd3676c985c41b0beece0337769a738 in term 1.
I20260807 18:13:50.223134 21326 leader_election.cc:302] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 17c33b96ad82442794bbe16c2faf9e28, dcd3676c985c41b0beece0337769a738; no voters:
I20260807 18:13:50.223469 21396 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:13:50.224102 21396 raft_consensus.cc:686] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [term 1 LEADER]: Becoming Leader. State: Replica: dcd3676c985c41b0beece0337769a738, State: Running, Role: LEADER
I20260807 18:13:50.224711 21396 consensus_queue.cc:237] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } }
I20260807 18:13:50.228085 21421 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dcd3676c985c41b0beece0337769a738. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } }
I20260807 18:13:50.228514 21421 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: This master's current role is: LEADER
I20260807 18:13:50.229843 21425 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:13:50.231957 21425 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:13:50.241225 21262 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [term 1 FOLLOWER]: Refusing update from remote peer dcd3676c985c41b0beece0337769a738: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:13:50.242570 21421 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 18:13:50.247146 21434 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:13:50.247568 21434 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:13:50.252586 21416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dcd3676c985c41b0beece0337769a738. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } }
I20260807 18:13:50.252844 21416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:13:50.255192 21433 mvcc.cc:205] Tried to move back new op lower bound from 7315973858255577088 to 7315973858204454912. Current Snapshot: MvccSnapshot[applied={T|T < 7315973858255577088}]
I20260807 18:13:50.267726 21416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } }
I20260807 18:13:50.267997 21416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:13:50.270979 21425 catalog_manager.cc:1347] Generated new cluster ID: 336f1440dbe747b8bd41ea0848c85ad7
I20260807 18:13:50.271096 21425 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:13:50.272425 21421 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } }
I20260807 18:13:50.272711 21421 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: This master's current role is: LEADER
I20260807 18:13:50.296077 21425 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:13:50.297667 21425 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:13:50.312091 21425 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738: Generated new TSK 0
I20260807 18:13:50.313412 21425 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:13:50.330617 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.201.1:0
--local_ip_for_outbound_sockets=127.19.201.1
--webserver_interface=127.19.201.1
--webserver_port=0
--tserver_master_addrs=127.19.201.62:36601,127.19.201.61:43333
--builtin_ntp_servers=127.19.201.20:33403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20260807 18:13:50.702747 21443 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:13:50.703136 21443 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:13:50.703312 21443 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:13:50.711035 21443 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:13:50.711253 21443 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.201.1
I20260807 18:13:50.720995 21443 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:33403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.201.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.201.1
--webserver_port=0
--tserver_master_addrs=127.19.201.62:36601,127.19.201.61:43333
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.201.1
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
I20260807 18:13:50.722474 21443 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:13:50.724452 21443 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:13:50.738512 21449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:50.738479 21450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:50.739078 21454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:13:50.739872 21443 server_base.cc:1034] running on GCE node
I20260807 18:13:50.740557 21443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:13:50.741693 21443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:13:50.742962 21443 hybrid_clock.cc:648] HybridClock initialized: now 1786126430742892 us; error 40 us; skew 500 ppm
I20260807 18:13:50.743309 21443 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:13:50.745815 21443 webserver.cc:460] Webserver started at http://127.19.201.1:40137/ using document root <none> and password file <none>
I20260807 18:13:50.746572 21443 fs_manager.cc:359] Metadata directory not provided
I20260807 18:13:50.746730 21443 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:13:50.747080 21443 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:13:50.749919 21443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/ts-0/data/instance:
uuid: "7d63b6cdfcb343e0af9aa38f6afba720"
format_stamp: "Formatted at 2026-08-07 18:13:50 on dist-test-slave-bw88"
I20260807 18:13:50.750737 21443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/ts-0/wal/instance:
uuid: "7d63b6cdfcb343e0af9aa38f6afba720"
format_stamp: "Formatted at 2026-08-07 18:13:50 on dist-test-slave-bw88"
I20260807 18:13:50.756286 21443 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 18:13:50.760134 21463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:13:50.761680 21443 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:13:50.761874 21443 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/ts-0/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/ts-0/wal
uuid: "7d63b6cdfcb343e0af9aa38f6afba720"
format_stamp: "Formatted at 2026-08-07 18:13:50 on dist-test-slave-bw88"
I20260807 18:13:50.762111 21443 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:13:50.773018 21443 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:13:50.773950 21443 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:13:50.774266 21443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:13:50.775269 21443 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:13:50.776870 21443 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:13:50.776990 21443 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:13:50.777151 21443 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:13:50.777228 21443 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:13:50.814021 21443 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.1:36617
I20260807 18:13:50.814109 21614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.1:36617 every 8 connection(s)
I20260807 18:13:50.815526 21443 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb
I20260807 18:13:50.822829 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 21443
I20260807 18:13:50.823087 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/ts-0/wal/instance
I20260807 18:13:50.834280 21616 heartbeater.cc:347] Connected to a master server at 127.19.201.62:36601
I20260807 18:13:50.834712 21616 heartbeater.cc:464] Registering TS with master...
I20260807 18:13:50.835192 21615 heartbeater.cc:347] Connected to a master server at 127.19.201.61:43333
I20260807 18:13:50.835350 21615 heartbeater.cc:464] Registering TS with master...
I20260807 18:13:50.835963 21615 heartbeater.cc:511] Master 127.19.201.61:43333 requested a full tablet report, sending...
I20260807 18:13:50.835984 21616 heartbeater.cc:511] Master 127.19.201.62:36601 requested a full tablet report, sending...
I20260807 18:13:50.838721 21340 ts_manager.cc:194] Registered new tserver with Master: 7d63b6cdfcb343e0af9aa38f6afba720 (127.19.201.1:36617)
I20260807 18:13:50.838740 21244 ts_manager.cc:194] Registered new tserver with Master: 7d63b6cdfcb343e0af9aa38f6afba720 (127.19.201.1:36617)
I20260807 18:13:50.840581 21340 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.201.1:34119
I20260807 18:13:50.844901 20260 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20260807 18:13:50.850157 20260 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20260807 18:13:50.850472 20260 test_util.cc:268] Using random seed: -143700608
I20260807 18:13:50.875120 21340 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48604:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:13:50.904700 21528 tablet_service.cc:1467] Processing CreateTablet for tablet 3a4c06ec582c480db34f22126f5f6db4 (DEFAULT_TABLE table=test-workload [id=03beed1811c44da2b840b6452c2514c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:13:50.906122 21528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a4c06ec582c480db34f22126f5f6db4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:13:50.917188 21646 tablet_bootstrap.cc:492] T 3a4c06ec582c480db34f22126f5f6db4 P 7d63b6cdfcb343e0af9aa38f6afba720: Bootstrap starting.
I20260807 18:13:50.920414 21646 tablet_bootstrap.cc:654] T 3a4c06ec582c480db34f22126f5f6db4 P 7d63b6cdfcb343e0af9aa38f6afba720: Neither blocks nor log segments found. Creating new log.
I20260807 18:13:50.921670 21646 log.cc:824] T 3a4c06ec582c480db34f22126f5f6db4 P 7d63b6cdfcb343e0af9aa38f6afba720: Log is configured to *not* fsync() on all Append() calls
I20260807 18:13:50.924589 21646 tablet_bootstrap.cc:492] T 3a4c06ec582c480db34f22126f5f6db4 P 7d63b6cdfcb343e0af9aa38f6afba720: No bootstrap required, opened a new log
I20260807 18:13:50.924897 21646 ts_tablet_manager.cc:1397] T 3a4c06ec582c480db34f22126f5f6db4 P 7d63b6cdfcb343e0af9aa38f6afba720: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260807 18:13:50.932300 21646 raft_consensus.cc:348] T 3a4c06ec582c480db34f22126f5f6db4 P 7d63b6cdfcb343e0af9aa38f6afba720 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d63b6cdfcb343e0af9aa38f6afba720" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 36617 } }
I20260807 18:13:50.932713 21646 raft_consensus.cc:374] T 3a4c06ec582c480db34f22126f5f6db4 P 7d63b6cdfcb343e0af9aa38f6afba720 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:13:50.932833 21646 raft_consensus.cc:729] T 3a4c06ec582c480db34f22126f5f6db4 P 7d63b6cdfcb343e0af9aa38f6afba720 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d63b6cdfcb343e0af9aa38f6afba720, State: Initialized, Role: FOLLOWER
I20260807 18:13:50.933542 21646 consensus_queue.cc:260] T 3a4c06ec582c480db34f22126f5f6db4 P 7d63b6cdfcb343e0af9aa38f6afba720 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d63b6cdfcb343e0af9aa38f6afba720" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 36617 } }
I20260807 18:13:50.933815 21646 raft_consensus.cc:388] T 3a4c06ec582c480db34f22126f5f6db4 P 7d63b6cdfcb343e0af9aa38f6afba720 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:13:50.933983 21646 raft_consensus.cc:482] T 3a4c06ec582c480db34f22126f5f6db4 P 7d63b6cdfcb343e0af9aa38f6afba720 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:13:50.934177 21646 raft_consensus.cc:3037] T 3a4c06ec582c480db34f22126f5f6db4 P 7d63b6cdfcb343e0af9aa38f6afba720 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:13:50.936409 21646 raft_consensus.cc:504] T 3a4c06ec582c480db34f22126f5f6db4 P 7d63b6cdfcb343e0af9aa38f6afba720 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d63b6cdfcb343e0af9aa38f6afba720" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 36617 } }
I20260807 18:13:50.936967 21646 leader_election.cc:302] T 3a4c06ec582c480db34f22126f5f6db4 P 7d63b6cdfcb343e0af9aa38f6afba720 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d63b6cdfcb343e0af9aa38f6afba720; no voters:
I20260807 18:13:50.937659 21646 leader_election.cc:288] T 3a4c06ec582c480db34f22126f5f6db4 P 7d63b6cdfcb343e0af9aa38f6afba720 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:13:50.937837 21649 raft_consensus.cc:2781] T 3a4c06ec582c480db34f22126f5f6db4 P 7d63b6cdfcb343e0af9aa38f6afba720 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:13:50.938632 21649 raft_consensus.cc:686] T 3a4c06ec582c480db34f22126f5f6db4 P 7d63b6cdfcb343e0af9aa38f6afba720 [term 1 LEADER]: Becoming Leader. State: Replica: 7d63b6cdfcb343e0af9aa38f6afba720, State: Running, Role: LEADER
I20260807 18:13:50.938865 21615 heartbeater.cc:503] Master 127.19.201.61:43333 was elected leader, sending a full tablet report...
I20260807 18:13:50.939260 21649 consensus_queue.cc:237] T 3a4c06ec582c480db34f22126f5f6db4 P 7d63b6cdfcb343e0af9aa38f6afba720 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d63b6cdfcb343e0af9aa38f6afba720" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 36617 } }
I20260807 18:13:50.939661 21646 ts_tablet_manager.cc:1428] T 3a4c06ec582c480db34f22126f5f6db4 P 7d63b6cdfcb343e0af9aa38f6afba720: Time spent starting tablet: real 0.015s user 0.008s sys 0.008s
I20260807 18:13:50.950227 21340 catalog_manager.cc:5495] T 3a4c06ec582c480db34f22126f5f6db4 P 7d63b6cdfcb343e0af9aa38f6afba720 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d63b6cdfcb343e0af9aa38f6afba720 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "7d63b6cdfcb343e0af9aa38f6afba720" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d63b6cdfcb343e0af9aa38f6afba720" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 36617 } health_report { overall_health: HEALTHY } } }
I20260807 18:13:50.960579 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.60:35905
--webserver_interface=127.19.201.60
--webserver_port=0
--builtin_ntp_servers=127.19.201.20:33403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.201.62:36601,127.19.201.61:43333,127.19.201.60:35905
--tablet_copy_fault_crash_during_download_wal=1 with env {}
I20260807 18:13:51.249850 21434 catalog_manager.cc:1259] Loaded cluster ID: 336f1440dbe747b8bd41ea0848c85ad7
I20260807 18:13:51.250028 21434 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28: loading cluster ID for follower catalog manager: success
I20260807 18:13:51.252755 21434 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28: acquiring CA information for follower catalog manager: success
I20260807 18:13:51.254669 21434 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 18:13:51.313062 21659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:13:51.313449 21659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:13:51.313577 21659 flags.cc:425] Enabled unsafe flag: --tablet_copy_fault_crash_during_download_wal=1
W20260807 18:13:51.313652 21659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:13:51.321242 21659 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:13:51.321419 21659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:13:51.321545 21659 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:13:51.321614 21659 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:13:51.331259 21659 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:33403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.201.62:36601,127.19.201.61:43333,127.19.201.60:35905
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.60:35905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.201.60
--webserver_port=0
--tablet_copy_fault_crash_during_download_wal=1
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
I20260807 18:13:51.332841 21659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:13:51.335075 21659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:13:51.347759 21668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:51.347890 21670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:51.348043 21672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:13:51.348909 21659 server_base.cc:1034] running on GCE node
I20260807 18:13:51.349799 21659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:13:51.351266 21659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:13:51.352527 21659 hybrid_clock.cc:648] HybridClock initialized: now 1786126431352456 us; error 61 us; skew 500 ppm
I20260807 18:13:51.352911 21659 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:13:51.355295 21659 webserver.cc:460] Webserver started at http://127.19.201.60:34915/ using document root <none> and password file <none>
I20260807 18:13:51.356032 21659 fs_manager.cc:359] Metadata directory not provided
I20260807 18:13:51.356169 21659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:13:51.356535 21659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:13:51.359298 21659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data/instance:
uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11"
format_stamp: "Formatted at 2026-08-07 18:13:51 on dist-test-slave-bw88"
I20260807 18:13:51.360097 21659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal/instance:
uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11"
format_stamp: "Formatted at 2026-08-07 18:13:51 on dist-test-slave-bw88"
I20260807 18:13:51.365682 21659 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260807 18:13:51.369496 21678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:13:51.370899 21659 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:13:51.371097 21659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11"
format_stamp: "Formatted at 2026-08-07 18:13:51 on dist-test-slave-bw88"
I20260807 18:13:51.371331 21659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:13:51.403709 21659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:13:51.404675 21659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:13:51.405028 21659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:13:51.426820 21659 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.60:35905
I20260807 18:13:51.426755 21737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.60:35905 every 8 connection(s)
I20260807 18:13:51.428249 21659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data/info.pb
I20260807 18:13:51.432504 21740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:13:51.433885 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 21659
I20260807 18:13:51.439204 21740 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:13:51.454820 21740 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:13:51.462036 21740 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.60" port: 35905 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:13:51.475826 21740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11: Bootstrap starting.
I20260807 18:13:51.479321 21740 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11: Neither blocks nor log segments found. Creating new log.
I20260807 18:13:51.480414 21740 log.cc:824] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11: Log is configured to *not* fsync() on all Append() calls
I20260807 18:13:51.483057 21740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11: No bootstrap required, opened a new log
I20260807 18:13:51.490242 21740 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 35905 } }
I20260807 18:13:51.490549 21740 raft_consensus.cc:374] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:13:51.490717 21740 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cf75f8a55f4f9c91aaf63c4dc73e11, State: Initialized, Role: FOLLOWER
I20260807 18:13:51.491325 21740 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 35905 } }
I20260807 18:13:51.492208 21748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 35905 } } }
I20260807 18:13:51.492563 21748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:13:51.493295 21740 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:13:51.496696 21748 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:13:51.497080 21748 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 35905 } }
I20260807 18:13:51.499203 21262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17c33b96ad82442794bbe16c2faf9e28" is_pre_election: true
I20260807 18:13:51.499531 21353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcd3676c985c41b0beece0337769a738" is_pre_election: true
I20260807 18:13:51.498543 21748 leader_election.cc:288] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17c33b96ad82442794bbe16c2faf9e28 (127.19.201.62:36601), dcd3676c985c41b0beece0337769a738 (127.19.201.61:43333)
I20260807 18:13:51.500624 21679 leader_election.cc:302] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cf75f8a55f4f9c91aaf63c4dc73e11; no voters: 17c33b96ad82442794bbe16c2faf9e28, dcd3676c985c41b0beece0337769a738
I20260807 18:13:51.501075 21748 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 18:13:51.504053 21761 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:13:51.504199 21761 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:13:51.508490 21659 master_runner.cc:428] Detected that this master 80cf75f8a55f4f9c91aaf63c4dc73e11 is joining an existing cluster
I20260807 18:13:51.508581 21659 master_runner.cc:432] Initiating AddMaster RPC to add 127.19.201.60:35905
I20260807 18:13:51.536911 21339 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.19.201.60:35905: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11"
member_type: NON_VOTER
last_known_addr {
host: "127.19.201.60"
port: 35905
}
attrs {
promote: true
}
}
dest_uuid: "dcd3676c985c41b0beece0337769a738"
cas_config_opid_index: -1
I20260807 18:13:51.538691 21339 consensus_queue.cc:237] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } }
I20260807 18:13:51.541436 21262 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [term 1 FOLLOWER]: Refusing update from remote peer dcd3676c985c41b0beece0337769a738: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 18:13:51.541644 21712 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:13:51.542141 21774 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 18:13:51.544993 21712 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [term 1 FOLLOWER]: Refusing update from remote peer dcd3676c985c41b0beece0337769a738: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 18:13:51.545783 21774 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:13:51.545377 21639 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index -1 to 8, NON_VOTER 80cf75f8a55f4f9c91aaf63c4dc73e11 (127.19.201.60) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } } }
I20260807 18:13:51.549597 21639 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.19.201.60:35905
I20260807 18:13:51.550371 21659 master.cc:537] Master@127.19.201.60:35905 shutting down...
I20260807 18:13:51.550158 21774 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } } }
I20260807 18:13:51.550458 21774 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: This master's current role is: LEADER
I20260807 18:13:51.552074 21639 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } } }
I20260807 18:13:51.552361 21639 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: This master's current role is: LEADER
I20260807 18:13:51.551965 21262 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index -1 to 8, NON_VOTER 80cf75f8a55f4f9c91aaf63c4dc73e11 (127.19.201.60) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } } }
I20260807 18:13:51.557838 21777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } } }
I20260807 18:13:51.558835 21777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:13:51.567546 21712 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [term 1 LEARNER]: Committing config change with OpId 1.8: config changed from index -1 to 8, NON_VOTER 80cf75f8a55f4f9c91aaf63c4dc73e11 (127.19.201.60) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } } }
I20260807 18:13:51.588181 21779 mvcc.cc:205] Tried to move back new op lower bound from 7315973861179052032 to 7315973858204454912. Current Snapshot: MvccSnapshot[applied={T|T < 7315973858255577088 or (T in {7315973858474512384,7315973860882227200,7315973860917592064})}]
I20260807 18:13:51.591809 21748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dcd3676c985c41b0beece0337769a738. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } } }
I20260807 18:13:51.592142 21748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [sys.catalog]: This master's current role is: LEARNER
I20260807 18:13:51.592379 21781 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } } }
I20260807 18:13:51.592705 21781 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [sys.catalog]: This master's current role is: LEARNER
I20260807 18:13:51.592702 21788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } } }
I20260807 18:13:51.593459 21788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [sys.catalog]: This master's current role is: LEARNER
I20260807 18:13:51.594449 21659 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [term 1 LEARNER]: Raft consensus shutting down.
I20260807 18:13:51.595070 21659 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [term 1 LEARNER]: Raft consensus is shut down!
I20260807 18:13:51.595250 21659 tablet_replica.cc:330] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11: stopping tablet replica
I20260807 18:13:51.613672 21659 master.cc:552] Master@127.19.201.60:35905 shutdown complete.
I20260807 18:13:51.613780 21659 master_runner.cc:305] Clearing existing system tablet
I20260807 18:13:51.614228 21659 fs_manager.cc:359] Metadata directory not provided
I20260807 18:13:51.614331 21659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:13:51.617372 21659 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.001s
I20260807 18:13:51.619100 21792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:13:51.619553 21659 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:13:51.619849 21659 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.002s
I20260807 18:13:51.619951 21659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11"
format_stamp: "Formatted at 2026-08-07 18:13:51 on dist-test-slave-bw88"
I20260807 18:13:51.624783 21659 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:13:51.631806 21659 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 18:13:51.631999 21659 log.cc:1196] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11: Deleting WAL directory at /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260807 18:13:51.632555 21659 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11: Deleting consensus metadata
I20260807 18:13:51.632894 21659 master_runner.cc:315] Copying system tablet from 127.19.201.61:43333
I20260807 18:13:51.635673 21659 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11: tablet copy: Beginning tablet copy session from remote peer at address 127.19.201.61:43333
I20260807 18:13:51.644166 21366 tablet_copy_service.cc:140] P dcd3676c985c41b0beece0337769a738: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 80cf75f8a55f4f9c91aaf63c4dc73e11 ({username='slave'} at 127.0.0.1:48632)
I20260807 18:13:51.644443 21366 tablet_copy_service.cc:161] P dcd3676c985c41b0beece0337769a738: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 80cf75f8a55f4f9c91aaf63c4dc73e11 at {username='slave'} at 127.0.0.1:48632: session id = 80cf75f8a55f4f9c91aaf63c4dc73e11-00000000000000000000000000000000
I20260807 18:13:51.649156 21366 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 18:13:51.651571 21659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 18:13:51.658250 21659 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11: tablet copy: Starting download of 0 data blocks...
I20260807 18:13:51.658620 21659 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11: tablet copy: Starting download of 1 WAL segments...
W20260807 18:13:51.658907 21800 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260807 18:13:51.658983 21800 fault_injection.cc:44] THIS SERVER MAY CRASH!
I20260807 18:13:51.660003 21366 tablet_copy_service.cc:342] P dcd3676c985c41b0beece0337769a738: Request end of tablet copy session 80cf75f8a55f4f9c91aaf63c4dc73e11-00000000000000000000000000000000 received from {username='slave'} at 127.0.0.1:48632
I20260807 18:13:51.660226 21366 tablet_copy_service.cc:433] P dcd3676c985c41b0beece0337769a738: ending tablet copy session 80cf75f8a55f4f9c91aaf63c4dc73e11-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 80cf75f8a55f4f9c91aaf63c4dc73e11
W20260807 18:13:51.661706 21659 tablet_metadata.cc:476] failed to load DataDirGroup from superblock: Already present: tried to load directory group for tablet 00000000000000000000000000000000 but one is already registered
I20260807 18:13:51.661923 21659 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 18:13:51.668895 21659 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.0
I20260807 18:13:51.669108 21659 log.cc:1196] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11: Deleting WAL directory at /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
IO error: Injected failure on downloading wal
I20260807 18:13:52.144181 21774 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } } }
I20260807 18:13:52.144626 21774 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: This master's current role is: LEADER
W20260807 18:13:52.159018 21320 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.201.60:35905: connect: Connection refused (error 111)
W20260807 18:13:52.162868 21320 consensus_peers.cc:487] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 -> Peer 80cf75f8a55f4f9c91aaf63c4dc73e11 (127.19.201.60:35905): Couldn't send request to peer 80cf75f8a55f4f9c91aaf63c4dc73e11. Status: Network error: Client connection negotiation failed: client connection to 127.19.201.60:35905: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:13:52.461120 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.60:35905
--webserver_interface=127.19.201.60
--webserver_port=34915
--builtin_ntp_servers=127.19.201.20:33403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.201.62:36601,127.19.201.61:43333,127.19.201.60:35905
--tablet_copy_fault_crash_during_download_wal=1
--tablet_copy_fault_crash_during_download_wal=0 with env {}
I20260807 18:13:52.738749 21804 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } } }
I20260807 18:13:52.739202 21804 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: This master's current role is: LEADER
W20260807 18:13:52.944069 21810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:13:52.944370 21810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:13:52.944516 21810 flags.cc:425] Enabled unsafe flag: --tablet_copy_fault_crash_during_download_wal=0
W20260807 18:13:52.944573 21810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:13:52.952405 21810 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:13:52.952517 21810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:13:52.952574 21810 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:13:52.952615 21810 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:13:52.963203 21810 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:33403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.201.62:36601,127.19.201.61:43333,127.19.201.60:35905
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.60:35905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.201.60
--webserver_port=34915
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
I20260807 18:13:52.964920 21810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:13:52.967101 21810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:13:52.979951 21824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:52.979992 21825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:52.979915 21827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:13:52.980649 21810 server_base.cc:1034] running on GCE node
I20260807 18:13:52.981613 21810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:13:52.983037 21810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:13:52.984263 21810 hybrid_clock.cc:648] HybridClock initialized: now 1786126432984212 us; error 32 us; skew 500 ppm
I20260807 18:13:52.984710 21810 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:13:52.987303 21810 webserver.cc:460] Webserver started at http://127.19.201.60:34915/ using document root <none> and password file <none>
I20260807 18:13:52.988049 21810 fs_manager.cc:359] Metadata directory not provided
I20260807 18:13:52.988169 21810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:13:52.993952 21810 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 18:13:52.996832 21835 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:13:52.998257 21810 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 18:13:52.998449 21810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11"
format_stamp: "Formatted at 2026-08-07 18:13:51 on dist-test-slave-bw88"
I20260807 18:13:52.999850 21810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:13:53.033010 21810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:13:53.034000 21810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:13:53.034354 21810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:13:53.054080 21810 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.60:35905
I20260807 18:13:53.054129 21900 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.60:35905 every 8 connection(s)
I20260807 18:13:53.055719 21810 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data/info.pb
I20260807 18:13:53.057762 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 21810
I20260807 18:13:53.063513 21903 sys_catalog.cc:263] Verifying existing consensus state
I20260807 18:13:53.068516 21903 tablet_replica.cc:330] stopping tablet replica
I20260807 18:13:53.068753 21903 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [term 1 LEARNER]: Raft consensus shutting down.
I20260807 18:13:53.069491 21903 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 80cf75f8a55f4f9c91aaf63c4dc73e11 [term 1 LEARNER]: Raft consensus is shut down!
E20260807 18:13:53.070111 21903 master.cc:392] Unable to init master catalog manager: Corruption: Unable to initialize catalog manager: Failed to initialize sys tables async: failed to bootstrap system catalog: Unable to locally bootstrap tablet 00000000000000000000000000000000: TabletMetadata bootstrap state is TABLET_DATA_TOMBSTONED
I20260807 18:13:53.070372 21810 master.cc:537] Master@127.19.201.60:35905 shutting down...
I20260807 18:13:53.096714 21810 master.cc:552] Master@127.19.201.60:35905 shutdown complete.
Corruption: Unable to initialize catalog manager: Failed to initialize sys tables async: failed to bootstrap system catalog: Unable to locally bootstrap tablet 00000000000000000000000000000000: TabletMetadata bootstrap state is TABLET_DATA_TOMBSTONED
I20260807 18:13:53.316917 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.60:35905
--webserver_interface=127.19.201.60
--webserver_port=34915
--builtin_ntp_servers=127.19.201.20:33403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.201.62:36601,127.19.201.61:43333,127.19.201.60:35905
--tablet_copy_fault_crash_during_download_wal=1
--tablet_copy_fault_crash_during_download_wal=0 with env {}
W20260807 18:13:53.671494 21908 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:13:53.671800 21908 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:13:53.671888 21908 flags.cc:425] Enabled unsafe flag: --tablet_copy_fault_crash_during_download_wal=0
W20260807 18:13:53.671936 21908 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:13:53.679237 21908 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:13:53.679332 21908 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:13:53.679386 21908 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:13:53.679433 21908 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:13:53.688759 21908 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:33403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.201.62:36601,127.19.201.61:43333,127.19.201.60:35905
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.60:35905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.201.60
--webserver_port=34915
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
I20260807 18:13:53.690207 21908 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:13:53.692095 21908 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:13:53.705324 21919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:53.705374 21920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:53.705260 21922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:13:53.706660 21908 server_base.cc:1034] running on GCE node
I20260807 18:13:53.707618 21908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:13:53.709296 21908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:13:53.710575 21908 hybrid_clock.cc:648] HybridClock initialized: now 1786126433710522 us; error 36 us; skew 500 ppm
I20260807 18:13:53.710960 21908 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:13:53.727399 21908 webserver.cc:460] Webserver started at http://127.19.201.60:34915/ using document root <none> and password file <none>
I20260807 18:13:53.728366 21908 fs_manager.cc:359] Metadata directory not provided
I20260807 18:13:53.728516 21908 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:13:53.728924 21908 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:13:53.732046 21908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data/instance:
uuid: "d923330cbfc74e41aa97237a5520af05"
format_stamp: "Formatted at 2026-08-07 18:13:53 on dist-test-slave-bw88"
I20260807 18:13:53.732882 21908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal/instance:
uuid: "d923330cbfc74e41aa97237a5520af05"
format_stamp: "Formatted at 2026-08-07 18:13:53 on dist-test-slave-bw88"
I20260807 18:13:53.738638 21908 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260807 18:13:53.742542 21931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:13:53.744011 21908 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 18:13:53.744216 21908 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
uuid: "d923330cbfc74e41aa97237a5520af05"
format_stamp: "Formatted at 2026-08-07 18:13:53 on dist-test-slave-bw88"
I20260807 18:13:53.744464 21908 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:13:53.768162 21908 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:13:53.769183 21908 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:13:53.769546 21908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:13:53.789402 21908 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.60:35905
I20260807 18:13:53.789429 21997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.60:35905 every 8 connection(s)
I20260807 18:13:53.790966 21908 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data/info.pb
I20260807 18:13:53.795495 21999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:13:53.799896 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 21908
I20260807 18:13:53.803297 21999 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } has no permanent_uuid. Determining permanent_uuid...
W20260807 18:13:53.804780 21968 tablet_service.cc:374] Invalid argument: UpdateConsensus: Wrong destination UUID requested. Local UUID: d923330cbfc74e41aa97237a5520af05. Requested UUID: 80cf75f8a55f4f9c91aaf63c4dc73e11: from {username='slave'} at 127.0.0.1:35202: tablet_id: "00000000000000000000000000000000" caller_uuid: "dcd3676c985c41b0beece0337769a738" caller_term: 1 preceding_id { term: 1 index: 8 } dest_uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11" committed_index: 8 all_replicated_index: 8 safe_timestamp: 7315973872796999680 last_idx_appended_to_leader: 8
I20260807 18:13:53.810556 21320 consensus_queue.cc:579] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [LEADER]: The tablet replica hosted on peer 80cf75f8a55f4f9c91aaf63c4dc73e11 has failed
I20260807 18:13:53.811367 21813 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } } }
I20260807 18:13:53.811628 21813 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: This master's current role is: LEADER
I20260807 18:13:53.815481 21999 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:13:53.822333 21999 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.60" port: 35905 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:13:53.831965 21999 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: Bootstrap starting.
I20260807 18:13:53.835299 21999 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: Neither blocks nor log segments found. Creating new log.
I20260807 18:13:53.836364 21999 log.cc:824] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: Log is configured to *not* fsync() on all Append() calls
I20260807 18:13:53.839028 21999 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: No bootstrap required, opened a new log
I20260807 18:13:53.844132 21999 raft_consensus.cc:348] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 35905 } }
I20260807 18:13:53.844511 21999 raft_consensus.cc:374] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:13:53.844658 21999 raft_consensus.cc:729] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d923330cbfc74e41aa97237a5520af05, State: Initialized, Role: FOLLOWER
I20260807 18:13:53.845311 21999 consensus_queue.cc:260] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 35905 } }
I20260807 18:13:53.846275 22009 sys_catalog.cc:455] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 35905 } } }
I20260807 18:13:53.846597 22009 sys_catalog.cc:458] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:13:53.847383 21999 sys_catalog.cc:564] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 18:13:53.856595 22027 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:13:53.856750 22027 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:13:53.861809 21908 master.cc:537] Master@127.19.201.60:35905 shutting down...
I20260807 18:13:53.874846 21908 raft_consensus.cc:2229] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 18:13:53.875262 21908 raft_consensus.cc:2258] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 18:13:53.875459 21908 tablet_replica.cc:330] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: stopping tablet replica
I20260807 18:13:53.891569 21908 master.cc:552] Master@127.19.201.60:35905 shutdown complete.
Not implemented: Kudu only supports adding one master at a time; tentative Raft config doesn't match the UUIDs fetched from --master_addresses. Raft config + local UUID: [17c33b96ad82442794bbe16c2faf9e28,80cf75f8a55f4f9c91aaf63c4dc73e11,d923330cbfc74e41aa97237a5520af05,dcd3676c985c41b0beece0337769a738] vs fetched UUIDs: [17c33b96ad82442794bbe16c2faf9e28,d923330cbfc74e41aa97237a5520af05,dcd3676c985c41b0beece0337769a738], diff: []
I20260807 18:13:54.643272 21813 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } } }
I20260807 18:13:54.643682 21813 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: This master's current role is: LEADER
W20260807 18:13:54.644809 21320 consensus_peers.cc:487] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 -> Peer 80cf75f8a55f4f9c91aaf63c4dc73e11 (127.19.201.60:35905): Couldn't send request to peer 80cf75f8a55f4f9c91aaf63c4dc73e11. Error code: WRONG_SERVER_UUID (16). Status: Network error: Client connection negotiation failed: client connection to 127.19.201.60:35905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:13:55.192871 22035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:13:55.193300 22035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:13:55.201200 22035 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
I20260807 18:13:55.238569 21339 catalog_manager.cc:6979] Initiating ChangeConfig request to remove master 127.19.201.60:35905: tablet_id: "00000000000000000000000000000000"
type: REMOVE_PEER
server {
permanent_uuid: "80cf75f8a55f4f9c91aaf63c4dc73e11"
}
dest_uuid: "dcd3676c985c41b0beece0337769a738"
cas_config_opid_index: 8
I20260807 18:13:55.239358 21339 consensus_queue.cc:237] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } }
I20260807 18:13:55.241405 21261 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [term 1 FOLLOWER]: Refusing update from remote peer dcd3676c985c41b0beece0337769a738: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 18:13:55.242079 21813 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 18:13:55.245532 22058 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, NON_VOTER 80cf75f8a55f4f9c91aaf63c4dc73e11 (127.19.201.60) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } }
I20260807 18:13:55.246119 21261 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, NON_VOTER 80cf75f8a55f4f9c91aaf63c4dc73e11 (127.19.201.60) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } }
I20260807 18:13:55.249361 22058 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to remove master 127.19.201.60:35905
I20260807 18:13:55.249962 21813 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } }
I20260807 18:13:55.250229 21813 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: This master's current role is: LEADER
I20260807 18:13:55.250522 22035 tool_action_master.cc:566] Successfully removed master 127.19.201.60:35905 from the cluster. Please follow the next steps from the Kudu administration documentation on "Removing Kudu Masters from a Multi-Master Deployment" or "Recovering from a dead Kudu Master in a Multi-Master Deployment" as appropriate.
I20260807 18:13:55.250514 22059 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } }
I20260807 18:13:55.250828 22059 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:13:55.251910 22058 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } }
I20260807 18:13:55.252087 22058 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: This master's current role is: LEADER
I20260807 18:13:55.341777 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.60:35905
--webserver_interface=127.19.201.60
--webserver_port=34915
--builtin_ntp_servers=127.19.201.20:33403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.201.62:36601,127.19.201.61:43333,127.19.201.60:35905
--tablet_copy_fault_crash_during_download_wal=1
--tablet_copy_fault_crash_during_download_wal=0 with env {}
W20260807 18:13:55.693835 22064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:13:55.694157 22064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:13:55.694329 22064 flags.cc:425] Enabled unsafe flag: --tablet_copy_fault_crash_during_download_wal=0
W20260807 18:13:55.694383 22064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:13:55.702128 22064 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:13:55.702224 22064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:13:55.702319 22064 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:13:55.702381 22064 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:13:55.711887 22064 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:33403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.201.62:36601,127.19.201.61:43333,127.19.201.60:35905
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.60:35905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.201.60
--webserver_port=34915
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
I20260807 18:13:55.713694 22064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:13:55.715708 22064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:13:55.728875 22073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:55.728843 22069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:55.728817 22070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:13:55.729895 22064 server_base.cc:1034] running on GCE node
I20260807 18:13:55.730747 22064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:13:55.732324 22064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:13:55.733575 22064 hybrid_clock.cc:648] HybridClock initialized: now 1786126435733532 us; error 37 us; skew 500 ppm
I20260807 18:13:55.733966 22064 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:13:55.736269 22064 webserver.cc:460] Webserver started at http://127.19.201.60:34915/ using document root <none> and password file <none>
I20260807 18:13:55.736994 22064 fs_manager.cc:359] Metadata directory not provided
I20260807 18:13:55.737159 22064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:13:55.742651 22064 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260807 18:13:55.745762 22079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:13:55.747093 22064 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260807 18:13:55.747289 22064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
uuid: "d923330cbfc74e41aa97237a5520af05"
format_stamp: "Formatted at 2026-08-07 18:13:53 on dist-test-slave-bw88"
I20260807 18:13:55.748261 22064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:13:55.776839 22064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:13:55.777881 22064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:13:55.778215 22064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:13:55.798508 22064 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.60:35905
I20260807 18:13:55.798553 22149 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.60:35905 every 8 connection(s)
I20260807 18:13:55.800360 22064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data/info.pb
I20260807 18:13:55.803773 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 22064
I20260807 18:13:55.809831 22150 sys_catalog.cc:263] Verifying existing consensus state
I20260807 18:13:55.815431 22150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: Bootstrap starting.
I20260807 18:13:55.824200 22150 log.cc:824] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: Log is configured to *not* fsync() on all Append() calls
I20260807 18:13:55.827515 22150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 18:13:55.828222 22150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: Bootstrap complete.
I20260807 18:13:55.837380 22150 raft_consensus.cc:348] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 35905 } }
I20260807 18:13:55.838620 22150 raft_consensus.cc:374] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:13:55.838798 22150 raft_consensus.cc:729] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d923330cbfc74e41aa97237a5520af05, State: Initialized, Role: FOLLOWER
I20260807 18:13:55.839576 22150 consensus_queue.cc:260] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 35905 } }
I20260807 18:13:55.840530 22159 sys_catalog.cc:455] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 35905 } } }
I20260807 18:13:55.841020 22159 sys_catalog.cc:458] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:13:55.841995 22150 sys_catalog.cc:564] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 18:13:55.854743 22175 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:13:55.854982 22175 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:13:55.881044 22064 master_runner.cc:428] Detected that this master d923330cbfc74e41aa97237a5520af05 is joining an existing cluster
I20260807 18:13:55.881174 22064 master_runner.cc:432] Initiating AddMaster RPC to add 127.19.201.60:35905
I20260807 18:13:55.919315 21339 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.19.201.60:35905: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "d923330cbfc74e41aa97237a5520af05"
member_type: NON_VOTER
last_known_addr {
host: "127.19.201.60"
port: 35905
}
attrs {
promote: true
}
}
dest_uuid: "dcd3676c985c41b0beece0337769a738"
cas_config_opid_index: 9
I20260807 18:13:55.920153 21339 consensus_queue.cc:237] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } }
I20260807 18:13:55.923825 22116 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:13:55.924432 21261 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [term 1 FOLLOWER]: Refusing update from remote peer dcd3676c985c41b0beece0337769a738: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 18:13:55.925071 22194 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 18:13:55.927446 22158 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, NON_VOTER d923330cbfc74e41aa97237a5520af05 (127.19.201.60) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } } }
I20260807 18:13:55.928177 21261 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, NON_VOTER d923330cbfc74e41aa97237a5520af05 (127.19.201.60) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } } }
I20260807 18:13:55.931115 22158 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.19.201.60:35905
I20260807 18:13:55.931586 22158 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } } }
I20260807 18:13:55.931882 22158 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: This master's current role is: LEADER
I20260807 18:13:55.932633 22158 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } } }
I20260807 18:13:55.932930 22158 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: This master's current role is: LEADER
I20260807 18:13:55.933857 22195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } } }
I20260807 18:13:55.934166 22195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:13:55.941776 22064 master.cc:537] Master@127.19.201.60:35905 shutting down...
I20260807 18:13:55.951611 22116 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [term 1 FOLLOWER]: Refusing update from remote peer dcd3676c985c41b0beece0337769a738: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 18:13:55.952909 22194 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:13:55.960239 22064 raft_consensus.cc:2229] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:13:55.960723 22064 raft_consensus.cc:2258] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:13:55.960937 22064 tablet_replica.cc:330] stopping tablet replica
W20260807 18:13:55.963835 21320 consensus_peers.cc:487] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 -> Peer d923330cbfc74e41aa97237a5520af05 (127.19.201.60:35905): Couldn't send request to peer d923330cbfc74e41aa97237a5520af05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 18:13:55.979868 22064 master.cc:552] Master@127.19.201.60:35905 shutdown complete.
I20260807 18:13:55.980010 22064 master_runner.cc:305] Clearing existing system tablet
I20260807 18:13:55.980441 22064 fs_manager.cc:359] Metadata directory not provided
I20260807 18:13:55.980556 22064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:13:55.984972 22064 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.001s
I20260807 18:13:55.987354 22200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:13:55.988296 22064 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:13:55.988628 22064 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 18:13:55.988766 22064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
uuid: "d923330cbfc74e41aa97237a5520af05"
format_stamp: "Formatted at 2026-08-07 18:13:53 on dist-test-slave-bw88"
W20260807 18:13:55.990543 21339 master.cc:648] Network error: unable to get registration information for peer d923330cbfc74e41aa97237a5520af05: Client connection negotiation failed: client connection to 127.19.201.60:35905: connect: Connection refused (error 111)
I20260807 18:13:55.991873 22064 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:13:55.998839 22064 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 18:13:55.999085 22064 log.cc:1196] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: Deleting WAL directory at /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260807 18:13:55.999677 22064 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: Deleting consensus metadata
I20260807 18:13:55.999963 22064 master_runner.cc:315] Copying system tablet from 127.19.201.61:43333
I20260807 18:13:56.002853 22064 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: tablet copy: Beginning tablet copy session from remote peer at address 127.19.201.61:43333
I20260807 18:13:56.011243 21366 tablet_copy_service.cc:140] P dcd3676c985c41b0beece0337769a738: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer d923330cbfc74e41aa97237a5520af05 ({username='slave'} at 127.0.0.1:36652)
I20260807 18:13:56.011461 21366 tablet_copy_service.cc:161] P dcd3676c985c41b0beece0337769a738: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer d923330cbfc74e41aa97237a5520af05 at {username='slave'} at 127.0.0.1:36652: session id = d923330cbfc74e41aa97237a5520af05-00000000000000000000000000000000
I20260807 18:13:56.015378 21366 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 18:13:56.017654 22064 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 18:13:56.022614 22064 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: tablet copy: Starting download of 0 data blocks...
I20260807 18:13:56.022913 22064 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: tablet copy: Starting download of 1 WAL segments...
I20260807 18:13:56.025837 22064 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 18:13:56.029428 21366 tablet_copy_service.cc:342] P dcd3676c985c41b0beece0337769a738: Request end of tablet copy session d923330cbfc74e41aa97237a5520af05-00000000000000000000000000000000 received from {username='slave'} at 127.0.0.1:36652
I20260807 18:13:56.029579 21366 tablet_copy_service.cc:433] P dcd3676c985c41b0beece0337769a738: ending tablet copy session d923330cbfc74e41aa97237a5520af05-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer d923330cbfc74e41aa97237a5520af05
I20260807 18:13:56.041838 22064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:13:56.045049 22207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:13:56.051566 22209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:13:56.055094 22064 server_base.cc:1034] running on GCE node
W20260807 18:13:56.056118 22211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:13:56.057227 22064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:13:56.058115 22064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:13:56.059368 22064 hybrid_clock.cc:648] HybridClock initialized: now 1786126436059329 us; error 34 us; skew 500 ppm
I20260807 18:13:56.059656 22064 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:13:56.061573 22064 webserver.cc:460] Webserver started at http://127.19.201.60:34915/ using document root <none> and password file <none>
I20260807 18:13:56.061959 22064 fs_manager.cc:359] Metadata directory not provided
I20260807 18:13:56.062047 22064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:13:56.066354 22064 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.003s
I20260807 18:13:56.068673 22218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:13:56.069191 22064 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 18:13:56.069356 22064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
uuid: "d923330cbfc74e41aa97237a5520af05"
format_stamp: "Formatted at 2026-08-07 18:13:53 on dist-test-slave-bw88"
I20260807 18:13:56.069528 22064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:13:56.126380 22064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:13:56.127236 22064 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260807 18:13:56.131892 21339 master.cc:648] Network error: unable to get registration information for peer d923330cbfc74e41aa97237a5520af05: Client connection negotiation failed: client connection to 127.19.201.60:35905: connect: Connection refused (error 111)
I20260807 18:13:56.161408 22064 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.60:35905
I20260807 18:13:56.161481 22281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.60:35905 every 8 connection(s)
I20260807 18:13:56.163298 22064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.AutoAddMasterTest.TestFailTabletCopy.1786126423027121-20260-0/minicluster-data/master-2/data/info.pb
I20260807 18:13:56.169077 22282 sys_catalog.cc:263] Verifying existing consensus state
I20260807 18:13:56.172825 22282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: Bootstrap starting.
I20260807 18:13:56.196605 22282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 18:13:56.197217 22282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: Bootstrap complete.
I20260807 18:13:56.198612 22282 raft_consensus.cc:348] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } }
I20260807 18:13:56.198942 22282 raft_consensus.cc:729] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d923330cbfc74e41aa97237a5520af05, State: Initialized, Role: LEARNER
I20260807 18:13:56.199236 22282 consensus_queue.cc:260] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } }
I20260807 18:13:56.200177 22285 sys_catalog.cc:455] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } } }
I20260807 18:13:56.200497 22285 sys_catalog.cc:458] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [sys.catalog]: This master's current role is: LEARNER
I20260807 18:13:56.200529 22282 sys_catalog.cc:564] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:13:56.209645 22300 catalog_manager.cc:1259] Loaded cluster ID: 336f1440dbe747b8bd41ea0848c85ad7
I20260807 18:13:56.209748 22300 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: loading cluster ID for follower catalog manager: success
I20260807 18:13:56.212584 22300 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: acquiring CA information for follower catalog manager: success
I20260807 18:13:56.215034 22300 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 18:13:56.506275 22249 raft_consensus.cc:1203] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.10] Dedup: 1.10->[]
I20260807 18:13:56.507287 22285 sys_catalog.cc:455] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dcd3676c985c41b0beece0337769a738. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } } }
I20260807 18:13:56.507728 22285 sys_catalog.cc:458] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [sys.catalog]: This master's current role is: LEARNER
I20260807 18:13:56.909927 22194 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: true } } }
I20260807 18:13:56.910359 22194 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: This master's current role is: LEADER
I20260807 18:13:56.911569 22194 raft_consensus.cc:1050] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738: attempting to promote NON_VOTER d923330cbfc74e41aa97237a5520af05 to VOTER
I20260807 18:13:56.912349 22194 consensus_queue.cc:237] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: false } }
I20260807 18:13:56.914366 22249 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [term 1 LEARNER]: Refusing update from remote peer dcd3676c985c41b0beece0337769a738: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260807 18:13:56.914494 21261 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [term 1 FOLLOWER]: Refusing update from remote peer dcd3676c985c41b0beece0337769a738: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260807 18:13:56.914980 22304 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 18:13:56.915321 22303 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 18:13:56.917694 22303 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, d923330cbfc74e41aa97237a5520af05 (127.19.201.60) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: false } } }
I20260807 18:13:56.918299 21261 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, d923330cbfc74e41aa97237a5520af05 (127.19.201.60) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: false } } }
I20260807 18:13:56.920120 22249 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, d923330cbfc74e41aa97237a5520af05 (127.19.201.60) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: false } } }
I20260807 18:13:56.924602 22304 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: false } } }
I20260807 18:13:56.925233 22285 sys_catalog.cc:455] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: false } } }
I20260807 18:13:56.925552 22285 sys_catalog.cc:458] T 00000000000000000000000000000000 P d923330cbfc74e41aa97237a5520af05 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:13:56.925668 22304 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: This master's current role is: LEADER
I20260807 18:13:56.925716 22194 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: false } } }
I20260807 18:13:56.925963 22194 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: This master's current role is: LEADER
I20260807 18:13:56.926278 22194 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: false } } }
I20260807 18:13:56.926568 22194 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 [sys.catalog]: This master's current role is: LEADER
I20260807 18:13:56.930392 22312 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dcd3676c985c41b0beece0337769a738" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "17c33b96ad82442794bbe16c2faf9e28" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36601 } } peers { permanent_uuid: "dcd3676c985c41b0beece0337769a738" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 43333 } } peers { permanent_uuid: "d923330cbfc74e41aa97237a5520af05" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 35905 } attrs { promote: false } } }
I20260807 18:13:56.930982 22312 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17c33b96ad82442794bbe16c2faf9e28 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:13:59.943133 20260 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskorkq8y/build/asan/bin/kudu pid 21443
I20260807 18:13:59.963133 21607 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 18:14:00.055523 20260 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskorkq8y/build/asan/bin/kudu with pid 21443
W20260807 18:14:00.082857 21225 connection.cc:535] server connection from 127.19.201.1:56295 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 18:14:00.082993 20260 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskorkq8y/build/asan/bin/kudu pid 21203
W20260807 18:14:00.082629 21320 connection.cc:535] server connection from 127.19.201.1:34119 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 18:14:00.084399 21287 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 18:14:00.193562 20260 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskorkq8y/build/asan/bin/kudu with pid 21203
W20260807 18:14:00.225215 21326 connection.cc:535] client connection to 127.19.201.62:36601 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 18:14:00.225476 21326 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 6 similar messages]
I20260807 18:14:00.225708 20260 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskorkq8y/build/asan/bin/kudu pid 21296
I20260807 18:14:00.226883 21383 generic_service.cc:196] Checking for leaks (request via RPC)
W20260807 18:14:00.340701 21326 consensus_peers.cc:487] T 00000000000000000000000000000000 P dcd3676c985c41b0beece0337769a738 -> Peer 17c33b96ad82442794bbe16c2faf9e28 (127.19.201.62:36601): Couldn't send request to peer 17c33b96ad82442794bbe16c2faf9e28. Status: Network error: Client connection negotiation failed: client connection to 127.19.201.62:36601: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:14:00.340915 20260 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskorkq8y/build/asan/bin/kudu with pid 21296
I20260807 18:14:00.368824 20260 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskorkq8y/build/asan/bin/kudu pid 22064
I20260807 18:14:00.370141 22277 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 18:14:00.481153 20260 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskorkq8y/build/asan/bin/kudu with pid 22064
2026-08-07T18:14:00Z chronyd exiting
[ OK ] AutoAddMasterTest.TestFailTabletCopy (11554 ms)
[----------] 1 test from AutoAddMasterTest (11554 ms total)
[----------] 1 test from ParameterizedAddMasterTest
[ RUN ] ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL/2
2026-08-07T18:14:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:14:00Z Disabled control of system clock
I20260807 18:14:00.561834 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.62:40147
--webserver_interface=127.19.201.62
--webserver_port=0
--builtin_ntp_servers=127.19.201.20:42951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.201.62:40147,127.19.201.61:40441
--master_auto_join_cluster=false with env {}
W20260807 18:14:00.915849 22329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:14:00.916182 22329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:14:00.916332 22329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:14:00.923933 22329 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:14:00.924180 22329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:14:00.924248 22329 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:14:00.924300 22329 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:14:00.934017 22329 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:42951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.201.62:40147,127.19.201.61:40441
--master_auto_join_cluster=false
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.62:40147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.201.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
W20260807 18:14:00.934391 22329 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.19.201.62:40147,127.19.201.61:40441'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 18:14:00.935513 22329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:14:00.937532 22329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:14:00.950649 22341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:00.950866 22336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:00.950796 22338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:14:00.952359 22329 server_base.cc:1034] running on GCE node
I20260807 18:14:00.953260 22329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:14:00.954895 22329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:14:00.956111 22329 hybrid_clock.cc:648] HybridClock initialized: now 1786126440956068 us; error 41 us; skew 500 ppm
I20260807 18:14:00.956509 22329 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:14:00.959137 22329 webserver.cc:460] Webserver started at http://127.19.201.62:38373/ using document root <none> and password file <none>
I20260807 18:14:00.959950 22329 fs_manager.cc:359] Metadata directory not provided
I20260807 18:14:00.960083 22329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:14:00.960457 22329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:14:00.963588 22329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/data/instance:
uuid: "deeb18b772244461b68ce43fb99bd2ff"
format_stamp: "Formatted at 2026-08-07 18:14:00 on dist-test-slave-bw88"
I20260807 18:14:00.964479 22329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/wal/instance:
uuid: "deeb18b772244461b68ce43fb99bd2ff"
format_stamp: "Formatted at 2026-08-07 18:14:00 on dist-test-slave-bw88"
I20260807 18:14:00.970323 22329 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260807 18:14:00.974157 22348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:14:00.975757 22329 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:14:00.975965 22329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/wal
uuid: "deeb18b772244461b68ce43fb99bd2ff"
format_stamp: "Formatted at 2026-08-07 18:14:00 on dist-test-slave-bw88"
I20260807 18:14:00.976212 22329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:14:00.988619 22329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:14:00.989620 22329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:14:00.989929 22329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:14:01.019348 22329 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.62:40147
I20260807 18:14:01.019372 22423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.62:40147 every 8 connection(s)
I20260807 18:14:01.020865 22329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
I20260807 18:14:01.025234 22426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:01.026181 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 22329
I20260807 18:14:01.026407 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/wal/instance
I20260807 18:14:01.028061 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.61:40441
--webserver_interface=127.19.201.61
--webserver_port=0
--builtin_ntp_servers=127.19.201.20:42951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.201.62:40147,127.19.201.61:40441
--master_auto_join_cluster=false with env {}
I20260807 18:14:01.035341 22426 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:14:01.054430 22426 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } has no permanent_uuid. Determining permanent_uuid...
W20260807 18:14:01.055598 22350 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.201.61:40441: connect: Connection refused (error 111)
W20260807 18:14:01.057407 22426 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:40441: Network error: Client connection negotiation failed: client connection to 127.19.201.61:40441: connect: Connection refused (error 111)
I20260807 18:14:01.106797 22426 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } attempt: 1
W20260807 18:14:01.108983 22426 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:40441: Network error: Client connection negotiation failed: client connection to 127.19.201.61:40441: connect: Connection refused (error 111)
I20260807 18:14:01.177299 22426 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } attempt: 2
W20260807 18:14:01.179687 22426 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:40441: Network error: Client connection negotiation failed: client connection to 127.19.201.61:40441: connect: Connection refused (error 111)
I20260807 18:14:01.270988 22426 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } attempt: 3
W20260807 18:14:01.273242 22426 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:40441: Network error: Client connection negotiation failed: client connection to 127.19.201.61:40441: connect: Connection refused (error 111)
W20260807 18:14:01.389017 22428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:14:01.389402 22428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:14:01.389557 22428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:14:01.397207 22428 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:14:01.397329 22428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:14:01.397497 22428 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:14:01.397607 22428 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:14:01.407469 22428 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:42951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.201.62:40147,127.19.201.61:40441
--master_auto_join_cluster=false
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.61:40441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.201.61
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
W20260807 18:14:01.407907 22428 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.19.201.62:40147,127.19.201.61:40441'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 18:14:01.409104 22428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:14:01.411115 22428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 18:14:01.416591 22426 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } attempt: 4
W20260807 18:14:01.419047 22426 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:40441: Network error: Client connection negotiation failed: client connection to 127.19.201.61:40441: connect: Connection refused (error 111)
W20260807 18:14:01.424535 22439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:01.424562 22444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:01.424523 22442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:14:01.425441 22428 server_base.cc:1034] running on GCE node
I20260807 18:14:01.426301 22428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:14:01.427840 22428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:14:01.429085 22428 hybrid_clock.cc:648] HybridClock initialized: now 1786126441429031 us; error 66 us; skew 500 ppm
I20260807 18:14:01.429525 22428 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:14:01.432046 22428 webserver.cc:460] Webserver started at http://127.19.201.61:40257/ using document root <none> and password file <none>
I20260807 18:14:01.432852 22428 fs_manager.cc:359] Metadata directory not provided
I20260807 18:14:01.433003 22428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:14:01.433418 22428 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:14:01.436266 22428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/data/instance:
uuid: "672bcba6964843a19ce6805c9a7583c9"
format_stamp: "Formatted at 2026-08-07 18:14:01 on dist-test-slave-bw88"
I20260807 18:14:01.437147 22428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/wal/instance:
uuid: "672bcba6964843a19ce6805c9a7583c9"
format_stamp: "Formatted at 2026-08-07 18:14:01 on dist-test-slave-bw88"
I20260807 18:14:01.442836 22428 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 18:14:01.446537 22452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:14:01.447947 22428 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 18:14:01.448149 22428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/wal
uuid: "672bcba6964843a19ce6805c9a7583c9"
format_stamp: "Formatted at 2026-08-07 18:14:01 on dist-test-slave-bw88"
I20260807 18:14:01.448393 22428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:14:01.466610 22428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:14:01.467547 22428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:14:01.467866 22428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:14:01.487944 22428 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.61:40441
I20260807 18:14:01.487955 22519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.61:40441 every 8 connection(s)
I20260807 18:14:01.489444 22428 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb
I20260807 18:14:01.493676 22520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:01.494205 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 22428
I20260807 18:14:01.494395 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/wal/instance
I20260807 18:14:01.502789 22520 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:14:01.515477 22520 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:14:01.526386 22520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9: Bootstrap starting.
I20260807 18:14:01.529790 22520 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:01.531136 22520 log.cc:824] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9: Log is configured to *not* fsync() on all Append() calls
I20260807 18:14:01.533898 22520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9: No bootstrap required, opened a new log
I20260807 18:14:01.541963 22520 raft_consensus.cc:348] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } }
I20260807 18:14:01.542321 22520 raft_consensus.cc:374] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:01.542439 22520 raft_consensus.cc:729] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 672bcba6964843a19ce6805c9a7583c9, State: Initialized, Role: FOLLOWER
I20260807 18:14:01.543081 22520 consensus_queue.cc:260] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } }
I20260807 18:14:01.544042 22529 sys_catalog.cc:455] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } }
I20260807 18:14:01.544440 22529 sys_catalog.cc:458] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:01.545162 22520 sys_catalog.cc:564] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 18:14:01.554163 22544 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:14:01.554278 22544 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:14:01.718453 22426 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } attempt: 5
W20260807 18:14:01.720306 22459 tablet.cc:2369] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:14:01.731478 22426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff: Bootstrap starting.
I20260807 18:14:01.736034 22426 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:01.737469 22426 log.cc:824] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff: Log is configured to *not* fsync() on all Append() calls
I20260807 18:14:01.740931 22426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff: No bootstrap required, opened a new log
I20260807 18:14:01.749325 22426 raft_consensus.cc:348] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } }
I20260807 18:14:01.749748 22426 raft_consensus.cc:374] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:01.749886 22426 raft_consensus.cc:729] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deeb18b772244461b68ce43fb99bd2ff, State: Initialized, Role: FOLLOWER
I20260807 18:14:01.750543 22426 consensus_queue.cc:260] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } }
I20260807 18:14:01.751648 22548 sys_catalog.cc:455] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } }
I20260807 18:14:01.752099 22548 sys_catalog.cc:458] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:01.752977 22426 sys_catalog.cc:564] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: configured and running, proceeding with master startup.
W20260807 18:14:01.764438 22560 catalog_manager.cc:1558] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:14:01.764629 22560 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:14:01.840181 22529 raft_consensus.cc:482] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:14:01.840596 22529 raft_consensus.cc:504] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } }
I20260807 18:14:01.842352 22529 leader_election.cc:288] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers deeb18b772244461b68ce43fb99bd2ff (127.19.201.62:40147)
I20260807 18:14:01.843468 22386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "672bcba6964843a19ce6805c9a7583c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb18b772244461b68ce43fb99bd2ff" is_pre_election: true
I20260807 18:14:01.844224 22386 raft_consensus.cc:2454] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 672bcba6964843a19ce6805c9a7583c9 in term 0.
I20260807 18:14:01.845034 22453 leader_election.cc:302] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 672bcba6964843a19ce6805c9a7583c9, deeb18b772244461b68ce43fb99bd2ff; no voters:
I20260807 18:14:01.845597 22529 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:14:01.845780 22529 raft_consensus.cc:482] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:14:01.845911 22529 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:01.849735 22529 raft_consensus.cc:504] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } }
I20260807 18:14:01.850436 22529 leader_election.cc:288] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [CANDIDATE]: Term 1 election: Requested vote from peers deeb18b772244461b68ce43fb99bd2ff (127.19.201.62:40147)
I20260807 18:14:01.851136 22386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "672bcba6964843a19ce6805c9a7583c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb18b772244461b68ce43fb99bd2ff"
I20260807 18:14:01.851409 22386 raft_consensus.cc:3037] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:01.855145 22386 raft_consensus.cc:2454] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 672bcba6964843a19ce6805c9a7583c9 in term 1.
I20260807 18:14:01.855796 22453 leader_election.cc:302] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 672bcba6964843a19ce6805c9a7583c9, deeb18b772244461b68ce43fb99bd2ff; no voters:
I20260807 18:14:01.856354 22529 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:01.857368 22529 raft_consensus.cc:686] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 1 LEADER]: Becoming Leader. State: Replica: 672bcba6964843a19ce6805c9a7583c9, State: Running, Role: LEADER
I20260807 18:14:01.858083 22529 consensus_queue.cc:237] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } }
I20260807 18:14:01.862123 22562 sys_catalog.cc:455] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 672bcba6964843a19ce6805c9a7583c9. Latest consensus state: current_term: 1 leader_uuid: "672bcba6964843a19ce6805c9a7583c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } }
I20260807 18:14:01.862545 22562 sys_catalog.cc:458] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: This master's current role is: LEADER
I20260807 18:14:01.869071 22564 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:14:01.871564 22564 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:14:01.881727 22386 raft_consensus.cc:1261] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 1 FOLLOWER]: Refusing update from remote peer 672bcba6964843a19ce6805c9a7583c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:14:01.882923 22562 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:14:01.892582 22548 sys_catalog.cc:455] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 672bcba6964843a19ce6805c9a7583c9. Latest consensus state: current_term: 1 leader_uuid: "672bcba6964843a19ce6805c9a7583c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } }
I20260807 18:14:01.892870 22548 sys_catalog.cc:458] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:01.895323 22566 mvcc.cc:205] Tried to move back new op lower bound from 7315973905934778368 to 7315973905855778816. Current Snapshot: MvccSnapshot[applied={T|T < 7315973905934778368}]
I20260807 18:14:01.907358 22548 sys_catalog.cc:455] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "672bcba6964843a19ce6805c9a7583c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } }
I20260807 18:14:01.907689 22548 sys_catalog.cc:458] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:01.913551 22562 sys_catalog.cc:455] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "672bcba6964843a19ce6805c9a7583c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } }
I20260807 18:14:01.913908 22562 sys_catalog.cc:458] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: This master's current role is: LEADER
I20260807 18:14:01.914330 22564 catalog_manager.cc:1347] Generated new cluster ID: 62166a6dc0ca431ab9c288d87d3e425d
I20260807 18:14:01.914453 22564 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:14:01.939314 22564 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:14:01.941390 22564 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:14:01.973923 22564 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9: Generated new TSK 0
I20260807 18:14:01.974993 22564 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:14:02.005761 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.201.1:0
--local_ip_for_outbound_sockets=127.19.201.1
--webserver_interface=127.19.201.1
--webserver_port=0
--tserver_master_addrs=127.19.201.62:40147,127.19.201.61:40441
--builtin_ntp_servers=127.19.201.20:42951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20260807 18:14:02.373860 22573 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:14:02.374168 22573 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:14:02.374337 22573 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:14:02.382011 22573 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:14:02.382229 22573 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.201.1
I20260807 18:14:02.391714 22573 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:42951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.201.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.201.1
--webserver_port=0
--tserver_master_addrs=127.19.201.62:40147,127.19.201.61:40441
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.201.1
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
I20260807 18:14:02.393218 22573 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:14:02.395141 22573 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:14:02.409320 22580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:02.409520 22583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:02.409368 22581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:14:02.410553 22573 server_base.cc:1034] running on GCE node
I20260807 18:14:02.411217 22573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:14:02.412180 22573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:14:02.413489 22573 hybrid_clock.cc:648] HybridClock initialized: now 1786126442413413 us; error 37 us; skew 500 ppm
I20260807 18:14:02.413834 22573 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:14:02.416296 22573 webserver.cc:460] Webserver started at http://127.19.201.1:37489/ using document root <none> and password file <none>
I20260807 18:14:02.417064 22573 fs_manager.cc:359] Metadata directory not provided
I20260807 18:14:02.417210 22573 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:14:02.417601 22573 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:14:02.420373 22573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/data/instance:
uuid: "28ae4bac80fa40119e626503bf0c48fc"
format_stamp: "Formatted at 2026-08-07 18:14:02 on dist-test-slave-bw88"
I20260807 18:14:02.421218 22573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/wal/instance:
uuid: "28ae4bac80fa40119e626503bf0c48fc"
format_stamp: "Formatted at 2026-08-07 18:14:02 on dist-test-slave-bw88"
I20260807 18:14:02.426734 22573 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 18:14:02.430536 22593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:14:02.432015 22573 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:14:02.432220 22573 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/wal
uuid: "28ae4bac80fa40119e626503bf0c48fc"
format_stamp: "Formatted at 2026-08-07 18:14:02 on dist-test-slave-bw88"
I20260807 18:14:02.432440 22573 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:14:02.476253 22573 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:14:02.477236 22573 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:14:02.477586 22573 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:14:02.478614 22573 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:14:02.480360 22573 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:14:02.480466 22573 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:14:02.480620 22573 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:14:02.480691 22573 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:14:02.521386 22573 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.1:36467
I20260807 18:14:02.521420 22741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.1:36467 every 8 connection(s)
I20260807 18:14:02.522795 22573 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb
I20260807 18:14:02.533499 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 22573
I20260807 18:14:02.533710 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/wal/instance
I20260807 18:14:02.540701 22744 heartbeater.cc:347] Connected to a master server at 127.19.201.62:40147
I20260807 18:14:02.540755 22742 heartbeater.cc:347] Connected to a master server at 127.19.201.61:40441
I20260807 18:14:02.541144 22742 heartbeater.cc:464] Registering TS with master...
I20260807 18:14:02.541147 22744 heartbeater.cc:464] Registering TS with master...
I20260807 18:14:02.542413 22744 heartbeater.cc:511] Master 127.19.201.62:40147 requested a full tablet report, sending...
I20260807 18:14:02.542440 22742 heartbeater.cc:511] Master 127.19.201.61:40441 requested a full tablet report, sending...
I20260807 18:14:02.544826 22480 ts_manager.cc:194] Registered new tserver with Master: 28ae4bac80fa40119e626503bf0c48fc (127.19.201.1:36467)
I20260807 18:14:02.544893 22372 ts_manager.cc:194] Registered new tserver with Master: 28ae4bac80fa40119e626503bf0c48fc (127.19.201.1:36467)
I20260807 18:14:02.546556 22480 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.201.1:45469
I20260807 18:14:02.555676 20260 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20260807 18:14:02.561043 20260 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20260807 18:14:02.583271 22480 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38760:
name: "first_table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:02.618021 22662 tablet_service.cc:1467] Processing CreateTablet for tablet 9eb3adcbd9864f3e807d2d496e55b8b3 (DEFAULT_TABLE table=first_table [id=c4630185368b45f797fd3fea2e131762]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:02.619441 22662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9eb3adcbd9864f3e807d2d496e55b8b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:02.630986 22771 tablet_bootstrap.cc:492] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc: Bootstrap starting.
I20260807 18:14:02.634183 22771 tablet_bootstrap.cc:654] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:02.635366 22771 log.cc:824] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc: Log is configured to *not* fsync() on all Append() calls
I20260807 18:14:02.638425 22771 tablet_bootstrap.cc:492] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc: No bootstrap required, opened a new log
I20260807 18:14:02.638737 22771 ts_tablet_manager.cc:1397] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260807 18:14:02.646430 22771 raft_consensus.cc:348] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 36467 } }
I20260807 18:14:02.646879 22771 raft_consensus.cc:374] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:02.647001 22771 raft_consensus.cc:729] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28ae4bac80fa40119e626503bf0c48fc, State: Initialized, Role: FOLLOWER
I20260807 18:14:02.647687 22771 consensus_queue.cc:260] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 36467 } }
I20260807 18:14:02.647970 22771 raft_consensus.cc:388] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:02.648140 22771 raft_consensus.cc:482] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:02.648343 22771 raft_consensus.cc:3037] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:02.650665 22771 raft_consensus.cc:504] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 36467 } }
I20260807 18:14:02.651180 22771 leader_election.cc:302] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 28ae4bac80fa40119e626503bf0c48fc; no voters:
I20260807 18:14:02.651867 22771 leader_election.cc:288] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:02.651996 22774 raft_consensus.cc:2781] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:02.653049 22742 heartbeater.cc:503] Master 127.19.201.61:40441 was elected leader, sending a full tablet report...
I20260807 18:14:02.653498 22774 raft_consensus.cc:686] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [term 1 LEADER]: Becoming Leader. State: Replica: 28ae4bac80fa40119e626503bf0c48fc, State: Running, Role: LEADER
I20260807 18:14:02.653956 22771 ts_tablet_manager.cc:1428] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc: Time spent starting tablet: real 0.015s user 0.015s sys 0.001s
I20260807 18:14:02.654104 22774 consensus_queue.cc:237] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 36467 } }
I20260807 18:14:02.660351 22480 catalog_manager.cc:5495] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 28ae4bac80fa40119e626503bf0c48fc (127.19.201.1). New cstate: current_term: 1 leader_uuid: "28ae4bac80fa40119e626503bf0c48fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 36467 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:02.766888 22560 catalog_manager.cc:1259] Loaded cluster ID: 62166a6dc0ca431ab9c288d87d3e425d
I20260807 18:14:02.767010 22560 catalog_manager.cc:1552] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff: loading cluster ID for follower catalog manager: success
I20260807 18:14:02.769719 22560 catalog_manager.cc:1574] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff: acquiring CA information for follower catalog manager: success
I20260807 18:14:02.771538 22560 catalog_manager.cc:1602] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 18:14:03.634951 22480 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.19.201.60:42911: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463"
member_type: NON_VOTER
last_known_addr {
host: "127.19.201.60"
port: 42911
}
attrs {
promote: true
}
}
dest_uuid: "672bcba6964843a19ce6805c9a7583c9"
cas_config_opid_index: -1
I20260807 18:14:03.636205 22480 consensus_queue.cc:237] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: true } }
I20260807 18:14:03.643314 22386 raft_consensus.cc:1261] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 1 FOLLOWER]: Refusing update from remote peer 672bcba6964843a19ce6805c9a7583c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 18:14:03.643565 22914 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:14:03.644110 22906 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 18:14:03.652290 22914 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index -1 to 8, NON_VOTER e1aa121c9b6f4bb5af976f908b3d0463 (127.19.201.60) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: true } } }
I20260807 18:14:03.653102 22386 raft_consensus.cc:2932] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index -1 to 8, NON_VOTER e1aa121c9b6f4bb5af976f908b3d0463 (127.19.201.60) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: true } } }
I20260807 18:14:03.657824 22914 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.19.201.60:42911
I20260807 18:14:03.662569 22906 sys_catalog.cc:455] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "672bcba6964843a19ce6805c9a7583c9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: true } } }
I20260807 18:14:03.664372 22906 sys_catalog.cc:458] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: This master's current role is: LEADER
I20260807 18:14:03.665159 22915 sys_catalog.cc:455] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "672bcba6964843a19ce6805c9a7583c9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: true } } }
I20260807 18:14:03.668352 22915 sys_catalog.cc:458] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: This master's current role is: LEADER
I20260807 18:14:03.674913 22918 sys_catalog.cc:455] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "672bcba6964843a19ce6805c9a7583c9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: true } } }
I20260807 18:14:03.675719 22918 sys_catalog.cc:458] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:03.718684 22906 sys_catalog.cc:455] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "672bcba6964843a19ce6805c9a7583c9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: NON_VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: true } } }
I20260807 18:14:03.719080 22906 sys_catalog.cc:458] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: This master's current role is: LEADER
I20260807 18:14:03.728245 22914 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9: attempting to promote NON_VOTER e1aa121c9b6f4bb5af976f908b3d0463 to VOTER
I20260807 18:14:03.729856 22914 consensus_queue.cc:237] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } }
I20260807 18:14:03.732683 22386 raft_consensus.cc:1261] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 1 FOLLOWER]: Refusing update from remote peer 672bcba6964843a19ce6805c9a7583c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 18:14:03.733443 22915 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 18:14:03.733877 22906 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 18:14:03.736546 22915 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, e1aa121c9b6f4bb5af976f908b3d0463 (127.19.201.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:03.737730 22386 raft_consensus.cc:2932] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, e1aa121c9b6f4bb5af976f908b3d0463 (127.19.201.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:03.741886 22914 sys_catalog.cc:455] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "672bcba6964843a19ce6805c9a7583c9" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:03.742311 22914 sys_catalog.cc:458] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: This master's current role is: LEADER
I20260807 18:14:03.742933 22918 sys_catalog.cc:455] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "672bcba6964843a19ce6805c9a7583c9" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:03.743026 22915 sys_catalog.cc:455] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "672bcba6964843a19ce6805c9a7583c9" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:03.743321 22918 sys_catalog.cc:458] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:03.743387 22915 sys_catalog.cc:458] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: This master's current role is: LEADER
I20260807 18:14:03.743885 22914 sys_catalog.cc:455] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "672bcba6964843a19ce6805c9a7583c9" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:03.744266 22914 sys_catalog.cc:458] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: This master's current role is: LEADER
W20260807 18:14:04.356257 22457 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.201.60:42911: connect: Connection refused (error 111)
W20260807 18:14:04.357996 22457 consensus_peers.cc:487] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 -> Peer e1aa121c9b6f4bb5af976f908b3d0463 (127.19.201.60:42911): Couldn't send request to peer e1aa121c9b6f4bb5af976f908b3d0463. Status: Network error: Client connection negotiation failed: client connection to 127.19.201.60:42911: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:14:04.874163 22939 sys_catalog.cc:455] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "672bcba6964843a19ce6805c9a7583c9" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:04.874650 22939 sys_catalog.cc:458] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: This master's current role is: LEADER
W20260807 18:14:05.263826 22480 master_service.cc:291] Master 127.19.201.60:42911 already present
I20260807 18:14:05.937162 22969 sys_catalog.cc:455] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "672bcba6964843a19ce6805c9a7583c9" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:05.937613 22969 sys_catalog.cc:458] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: This master's current role is: LEADER
W20260807 18:14:05.940507 22457 consensus_peers.cc:487] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 -> Peer e1aa121c9b6f4bb5af976f908b3d0463 (127.19.201.60:42911): Couldn't send request to peer e1aa121c9b6f4bb5af976f908b3d0463. Status: Network error: Client connection negotiation failed: client connection to 127.19.201.60:42911: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:14:06.047091 20260 dynamic_multi_master-test.cc:554] Add master stderr: W20260807 18:14:05.914669 23107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:14:05.914986 23107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:14:05.915077 23107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:14:05.922353 23107 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:14:05.922475 23107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:14:05.922531 23107 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:14:05.922590 23107 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 18:14:05.922663 23107 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Illegal state: Failed bringing up new master. See Kudu Master log for details.: Master 127.19.201.62:40147 already running
I20260807 18:14:06.050704 20260 fs_manager.cc:359] Metadata directory not provided
I20260807 18:14:06.050886 20260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:14:06.053929 20260 dynamic_multi_master-test.cc:645] Shutting down the old cluster
I20260807 18:14:06.054100 20260 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskorkq8y/build/asan/bin/kudu pid 22573
I20260807 18:14:06.062938 22737 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 18:14:06.152237 20260 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskorkq8y/build/asan/bin/kudu with pid 22573
I20260807 18:14:06.180074 20260 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskorkq8y/build/asan/bin/kudu pid 22329
I20260807 18:14:06.181562 22412 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 18:14:06.334205 20260 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskorkq8y/build/asan/bin/kudu with pid 22329
I20260807 18:14:06.363411 20260 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskorkq8y/build/asan/bin/kudu pid 22428
I20260807 18:14:06.364584 22513 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 18:14:06.479149 20260 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskorkq8y/build/asan/bin/kudu with pid 22428
2026-08-07T18:14:06Z chronyd exiting
I20260807 18:14:06.518155 20260 dynamic_multi_master-test.cc:648] Bringing up the migrated cluster
2026-08-07T18:14:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:14:06Z Disabled control of system clock
I20260807 18:14:06.549837 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.62:40147
--webserver_interface=127.19.201.62
--webserver_port=0
--builtin_ntp_servers=127.19.201.20:38679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.201.62:40147,127.19.201.61:40441,127.19.201.60:42911
--master_auto_join_cluster=false with env {}
W20260807 18:14:06.894748 23134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:14:06.895125 23134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:14:06.895277 23134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:14:06.902595 23134 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:14:06.902760 23134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:14:06.902858 23134 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:14:06.902959 23134 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:14:06.912299 23134 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:38679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.201.62:40147,127.19.201.61:40441,127.19.201.60:42911
--master_auto_join_cluster=false
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.62:40147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.201.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
I20260807 18:14:06.913864 23134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:14:06.915769 23134 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:14:06.927951 23141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:06.928068 23143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:06.928552 23140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:14:06.928913 23134 server_base.cc:1034] running on GCE node
I20260807 18:14:06.929841 23134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:14:06.931407 23134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:14:06.932689 23134 hybrid_clock.cc:648] HybridClock initialized: now 1786126446932602 us; error 56 us; skew 500 ppm
I20260807 18:14:06.933096 23134 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:14:06.935877 23134 webserver.cc:460] Webserver started at http://127.19.201.62:35549/ using document root <none> and password file <none>
I20260807 18:14:06.936654 23134 fs_manager.cc:359] Metadata directory not provided
I20260807 18:14:06.936826 23134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:14:06.942570 23134 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.002s
I20260807 18:14:06.945761 23152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:14:06.947175 23134 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 18:14:06.947372 23134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/wal
uuid: "deeb18b772244461b68ce43fb99bd2ff"
format_stamp: "Formatted at 2026-08-07 18:14:00 on dist-test-slave-bw88"
I20260807 18:14:06.948370 23134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:14:06.964967 23134 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:14:06.965986 23134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:14:06.966317 23134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:14:06.985723 23134 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.62:40147
I20260807 18:14:06.985761 23220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.62:40147 every 8 connection(s)
I20260807 18:14:06.987341 23134 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
I20260807 18:14:06.990844 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 23134
I20260807 18:14:06.991035 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/wal/instance
I20260807 18:14:06.992190 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.61:40441
--webserver_interface=127.19.201.61
--webserver_port=0
--builtin_ntp_servers=127.19.201.20:38679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.201.62:40147,127.19.201.61:40441,127.19.201.60:42911
--master_auto_join_cluster=false with env {}
I20260807 18:14:06.994673 23221 sys_catalog.cc:263] Verifying existing consensus state
I20260807 18:14:06.998323 23221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff: Bootstrap starting.
I20260807 18:14:07.016422 23221 log.cc:824] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff: Log is configured to *not* fsync() on all Append() calls
I20260807 18:14:07.028883 23221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 18:14:07.029541 23221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff: Bootstrap complete.
I20260807 18:14:07.039001 23221 raft_consensus.cc:348] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } }
I20260807 18:14:07.039898 23221 raft_consensus.cc:729] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: deeb18b772244461b68ce43fb99bd2ff, State: Initialized, Role: FOLLOWER
I20260807 18:14:07.040518 23221 consensus_queue.cc:260] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } }
I20260807 18:14:07.041430 23225 sys_catalog.cc:455] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:07.041914 23225 sys_catalog.cc:458] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:07.042685 23221 sys_catalog.cc:564] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:14:07.052927 23242 catalog_manager.cc:1259] Loaded cluster ID: 62166a6dc0ca431ab9c288d87d3e425d
I20260807 18:14:07.053050 23242 catalog_manager.cc:1552] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff: loading cluster ID for follower catalog manager: success
I20260807 18:14:07.057440 23242 catalog_manager.cc:1574] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff: acquiring CA information for follower catalog manager: success
I20260807 18:14:07.060175 23242 catalog_manager.cc:1602] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 18:14:07.361271 23223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:14:07.361677 23223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:14:07.361842 23223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:14:07.370258 23223 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:14:07.370371 23223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:14:07.370447 23223 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:14:07.370545 23223 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:14:07.380190 23223 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:38679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.201.62:40147,127.19.201.61:40441,127.19.201.60:42911
--master_auto_join_cluster=false
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.61:40441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.201.61
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
I20260807 18:14:07.381804 23223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:14:07.383879 23223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:14:07.398937 23252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:07.398916 23250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:07.402413 23249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:14:07.403400 23223 server_base.cc:1034] running on GCE node
I20260807 18:14:07.404449 23223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:14:07.406193 23223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:14:07.407490 23223 hybrid_clock.cc:648] HybridClock initialized: now 1786126447407399 us; error 54 us; skew 500 ppm
I20260807 18:14:07.407994 23223 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:14:07.410727 23223 webserver.cc:460] Webserver started at http://127.19.201.61:45539/ using document root <none> and password file <none>
I20260807 18:14:07.411545 23223 fs_manager.cc:359] Metadata directory not provided
I20260807 18:14:07.411732 23223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:14:07.418105 23223 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 18:14:07.421638 23259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:14:07.423224 23223 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:14:07.423435 23223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/wal
uuid: "672bcba6964843a19ce6805c9a7583c9"
format_stamp: "Formatted at 2026-08-07 18:14:01 on dist-test-slave-bw88"
I20260807 18:14:07.424487 23223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:14:07.448724 23223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:14:07.449795 23223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:14:07.450122 23223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:14:07.469673 23223 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.61:40441
I20260807 18:14:07.469695 23320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.61:40441 every 8 connection(s)
I20260807 18:14:07.471424 23223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb
I20260807 18:14:07.475185 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 23223
I20260807 18:14:07.475373 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/wal/instance
I20260807 18:14:07.476338 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.60:42911
--webserver_interface=127.19.201.60
--webserver_port=0
--builtin_ntp_servers=127.19.201.20:38679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.201.62:40147,127.19.201.61:40441,127.19.201.60:42911
--master_auto_join_cluster=false with env {}
I20260807 18:14:07.478931 23321 sys_catalog.cc:263] Verifying existing consensus state
I20260807 18:14:07.482607 23321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9: Bootstrap starting.
I20260807 18:14:07.507797 23321 log.cc:824] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9: Log is configured to *not* fsync() on all Append() calls
I20260807 18:14:07.523919 23321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 18:14:07.524626 23321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9: Bootstrap complete.
I20260807 18:14:07.534498 23321 raft_consensus.cc:348] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } }
I20260807 18:14:07.535403 23321 raft_consensus.cc:729] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 672bcba6964843a19ce6805c9a7583c9, State: Initialized, Role: FOLLOWER
I20260807 18:14:07.536043 23321 consensus_queue.cc:260] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } }
I20260807 18:14:07.536936 23325 sys_catalog.cc:455] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:07.537441 23325 sys_catalog.cc:458] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:07.538141 23321 sys_catalog.cc:564] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:14:07.549085 23339 catalog_manager.cc:1259] Loaded cluster ID: 62166a6dc0ca431ab9c288d87d3e425d
I20260807 18:14:07.549211 23339 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9: loading cluster ID for follower catalog manager: success
I20260807 18:14:07.553320 23339 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9: acquiring CA information for follower catalog manager: success
I20260807 18:14:07.556023 23339 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 18:14:07.849995 23323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:14:07.850328 23323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:14:07.850481 23323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:14:07.858114 23323 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:14:07.858243 23323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:14:07.858328 23323 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:14:07.858421 23323 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:14:07.868026 23323 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:38679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.201.62:40147,127.19.201.61:40441,127.19.201.60:42911
--master_auto_join_cluster=false
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.60:42911
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.201.60
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
I20260807 18:14:07.869618 23323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:14:07.871716 23323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:14:07.886150 23350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:07.886154 23349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:07.886217 23352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:14:07.887238 23323 server_base.cc:1034] running on GCE node
I20260807 18:14:07.888166 23323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:14:07.889860 23323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:14:07.891116 23323 hybrid_clock.cc:648] HybridClock initialized: now 1786126447891045 us; error 39 us; skew 500 ppm
I20260807 18:14:07.891489 23323 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:14:07.894148 23323 webserver.cc:460] Webserver started at http://127.19.201.60:40299/ using document root <none> and password file <none>
I20260807 18:14:07.894917 23323 fs_manager.cc:359] Metadata directory not provided
I20260807 18:14:07.895054 23323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:14:07.900961 23323 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 18:14:07.904259 23358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:14:07.905777 23323 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 18:14:07.905977 23323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-2/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-2/wal
uuid: "e1aa121c9b6f4bb5af976f908b3d0463"
format_stamp: "Formatted at 2026-08-07 18:14:03 on dist-test-slave-bw88"
I20260807 18:14:07.907008 23323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:14:07.935632 23323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:14:07.936605 23323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:14:07.936926 23323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:14:07.956710 23323 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.60:42911
I20260807 18:14:07.956718 23423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.60:42911 every 8 connection(s)
I20260807 18:14:07.958421 23323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-2/data/info.pb
I20260807 18:14:07.962548 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 23323
I20260807 18:14:07.962746 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-2/wal/instance
I20260807 18:14:07.967130 23424 sys_catalog.cc:263] Verifying existing consensus state
I20260807 18:14:07.971657 23424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463: Bootstrap starting.
I20260807 18:14:07.992995 23424 log.cc:824] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463: Log is configured to *not* fsync() on all Append() calls
I20260807 18:14:08.007867 23424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 18:14:08.008450 23424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463: Bootstrap complete.
I20260807 18:14:08.018030 23424 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } }
I20260807 18:14:08.019099 23424 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1aa121c9b6f4bb5af976f908b3d0463, State: Initialized, Role: FOLLOWER
I20260807 18:14:08.019969 23424 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } }
I20260807 18:14:08.021098 23436 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:08.021562 23436 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:08.022357 23424 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:14:08.032778 23452 catalog_manager.cc:1259] Loaded cluster ID: 62166a6dc0ca431ab9c288d87d3e425d
I20260807 18:14:08.032922 23452 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463: loading cluster ID for follower catalog manager: success
I20260807 18:14:08.036041 23452 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463: acquiring CA information for follower catalog manager: success
I20260807 18:14:08.038928 23452 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 18:14:08.368535 23454 raft_consensus.cc:482] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:14:08.368927 23454 raft_consensus.cc:504] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } }
I20260807 18:14:08.371526 23454 leader_election.cc:288] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 672bcba6964843a19ce6805c9a7583c9 (127.19.201.61:40441), e1aa121c9b6f4bb5af976f908b3d0463 (127.19.201.60:42911)
I20260807 18:14:08.384810 23290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "deeb18b772244461b68ce43fb99bd2ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "672bcba6964843a19ce6805c9a7583c9" is_pre_election: true
I20260807 18:14:08.385547 23290 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deeb18b772244461b68ce43fb99bd2ff in term 1.
I20260807 18:14:08.385972 23388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "deeb18b772244461b68ce43fb99bd2ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" is_pre_election: true
I20260807 18:14:08.386406 23153 leader_election.cc:302] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 672bcba6964843a19ce6805c9a7583c9, deeb18b772244461b68ce43fb99bd2ff; no voters:
I20260807 18:14:08.386646 23388 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deeb18b772244461b68ce43fb99bd2ff in term 1.
I20260807 18:14:08.386854 23454 raft_consensus.cc:2781] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 18:14:08.386986 23454 raft_consensus.cc:482] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:14:08.387086 23454 raft_consensus.cc:3037] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:14:08.391199 23454 raft_consensus.cc:504] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } }
I20260807 18:14:08.391875 23454 leader_election.cc:288] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [CANDIDATE]: Term 2 election: Requested vote from peers 672bcba6964843a19ce6805c9a7583c9 (127.19.201.61:40441), e1aa121c9b6f4bb5af976f908b3d0463 (127.19.201.60:42911)
I20260807 18:14:08.392477 23290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "deeb18b772244461b68ce43fb99bd2ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "672bcba6964843a19ce6805c9a7583c9"
I20260807 18:14:08.392517 23388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "deeb18b772244461b68ce43fb99bd2ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "e1aa121c9b6f4bb5af976f908b3d0463"
I20260807 18:14:08.392731 23388 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:14:08.392719 23290 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:14:08.398742 23290 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deeb18b772244461b68ce43fb99bd2ff in term 2.
I20260807 18:14:08.398747 23388 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deeb18b772244461b68ce43fb99bd2ff in term 2.
I20260807 18:14:08.399315 23156 leader_election.cc:302] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: deeb18b772244461b68ce43fb99bd2ff, e1aa121c9b6f4bb5af976f908b3d0463; no voters:
I20260807 18:14:08.399700 23454 raft_consensus.cc:2781] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 2 FOLLOWER]: Leader election won for term 2
I20260807 18:14:08.400267 23454 raft_consensus.cc:686] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 2 LEADER]: Becoming Leader. State: Replica: deeb18b772244461b68ce43fb99bd2ff, State: Running, Role: LEADER
I20260807 18:14:08.400782 23454 consensus_queue.cc:237] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } }
I20260807 18:14:08.403828 23457 sys_catalog.cc:455] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader deeb18b772244461b68ce43fb99bd2ff. Latest consensus state: current_term: 2 leader_uuid: "deeb18b772244461b68ce43fb99bd2ff" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:08.404371 23457 sys_catalog.cc:458] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: This master's current role is: LEADER
I20260807 18:14:08.405627 23459 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:14:08.408062 23459 catalog_manager.cc:669] Loaded metadata for table first_table [id=c4630185368b45f797fd3fea2e131762]
I20260807 18:14:08.409765 23459 tablet_loader.cc:96] loaded metadata for tablet 9eb3adcbd9864f3e807d2d496e55b8b3 (table first_table [id=c4630185368b45f797fd3fea2e131762])
I20260807 18:14:08.410066 23459 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:14:08.410965 23459 catalog_manager.cc:1259] Loaded cluster ID: 62166a6dc0ca431ab9c288d87d3e425d
I20260807 18:14:08.411041 23459 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:14:08.412585 23459 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:14:08.413581 23459 catalog_manager.cc:5879] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff: Loaded TSK: 0
I20260807 18:14:08.414494 23459 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:14:08.437383 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.201.1:0
--local_ip_for_outbound_sockets=127.19.201.1
--webserver_interface=127.19.201.1
--webserver_port=0
--tserver_master_addrs=127.19.201.62:40147,127.19.201.61:40441,127.19.201.60:42911
--builtin_ntp_servers=127.19.201.20:38679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20260807 18:14:08.793390 23460 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:14:08.793711 23460 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:14:08.793804 23460 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:14:08.801326 23460 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:14:08.801589 23460 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.201.1
I20260807 18:14:08.811123 23460 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:38679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.201.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.201.1
--webserver_port=0
--tserver_master_addrs=127.19.201.62:40147,127.19.201.61:40441,127.19.201.60:42911
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.201.1
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
I20260807 18:14:08.812739 23460 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:14:08.814702 23460 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:14:08.828722 23470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:08.828676 23469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:08.828760 23472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:14:08.829998 23460 server_base.cc:1034] running on GCE node
I20260807 18:14:08.830680 23460 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:14:08.831627 23460 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:14:08.832866 23460 hybrid_clock.cc:648] HybridClock initialized: now 1786126448832783 us; error 49 us; skew 500 ppm
I20260807 18:14:08.833192 23460 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:14:08.835711 23460 webserver.cc:460] Webserver started at http://127.19.201.1:37441/ using document root <none> and password file <none>
I20260807 18:14:08.836458 23460 fs_manager.cc:359] Metadata directory not provided
I20260807 18:14:08.836629 23460 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:14:08.842474 23460 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 18:14:08.845762 23478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:14:08.847218 23460 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 18:14:08.847399 23460 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/wal
uuid: "28ae4bac80fa40119e626503bf0c48fc"
format_stamp: "Formatted at 2026-08-07 18:14:02 on dist-test-slave-bw88"
I20260807 18:14:08.848421 23460 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:14:08.876330 23460 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:14:08.877282 23460 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:14:08.877612 23460 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:14:08.878669 23460 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:14:08.880761 23487 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260807 18:14:08.886863 23460 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 18:14:08.887012 23460 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260807 18:14:08.887157 23460 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 18:14:08.890453 23460 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 18:14:08.890558 23460 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.003s sys 0.000s
I20260807 18:14:08.890982 23487 tablet_bootstrap.cc:492] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc: Bootstrap starting.
I20260807 18:14:08.912403 23487 log.cc:824] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc: Log is configured to *not* fsync() on all Append() calls
I20260807 18:14:08.919301 23487 tablet_bootstrap.cc:492] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 18:14:08.920460 23487 tablet_bootstrap.cc:492] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc: Bootstrap complete.
I20260807 18:14:08.922041 23487 ts_tablet_manager.cc:1397] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc: Time spent bootstrapping tablet: real 0.031s user 0.018s sys 0.011s
I20260807 18:14:08.936468 23460 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.1:41029
I20260807 18:14:08.936532 23628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.1:41029 every 8 connection(s)
I20260807 18:14:08.938405 23460 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb
I20260807 18:14:08.941993 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 23460
I20260807 18:14:08.942203 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/wal/instance
I20260807 18:14:08.940542 23487 raft_consensus.cc:348] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 36467 } }
I20260807 18:14:08.951429 23487 raft_consensus.cc:729] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28ae4bac80fa40119e626503bf0c48fc, State: Initialized, Role: FOLLOWER
I20260807 18:14:08.952780 23487 consensus_queue.cc:260] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 36467 } }
I20260807 18:14:08.954391 23487 raft_consensus.cc:388] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:08.954895 23487 raft_consensus.cc:482] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:08.955430 23487 raft_consensus.cc:3037] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:14:08.969480 23487 raft_consensus.cc:504] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 36467 } }
I20260807 18:14:08.970799 23487 leader_election.cc:302] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 28ae4bac80fa40119e626503bf0c48fc; no voters:
I20260807 18:14:08.978327 23290 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 2 FOLLOWER]: Refusing update from remote peer deeb18b772244461b68ce43fb99bd2ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260807 18:14:08.981808 23637 consensus_queue.cc:1035] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 18:14:08.982476 23632 heartbeater.cc:347] Connected to a master server at 127.19.201.61:40441
I20260807 18:14:08.982818 23632 heartbeater.cc:464] Registering TS with master...
I20260807 18:14:08.983808 23632 heartbeater.cc:511] Master 127.19.201.61:40441 requested a full tablet report, sending...
I20260807 18:14:08.983870 23642 raft_consensus.cc:2781] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [term 2 FOLLOWER]: Leader election won for term 2
I20260807 18:14:08.984609 23487 leader_election.cc:288] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 18:14:08.990156 23646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader deeb18b772244461b68ce43fb99bd2ff. Latest consensus state: current_term: 2 leader_uuid: "deeb18b772244461b68ce43fb99bd2ff" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:08.990717 23646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:08.991076 23629 heartbeater.cc:347] Connected to a master server at 127.19.201.60:42911
I20260807 18:14:08.991230 23629 heartbeater.cc:464] Registering TS with master...
I20260807 18:14:08.991736 23629 heartbeater.cc:511] Master 127.19.201.60:42911 requested a full tablet report, sending...
I20260807 18:14:08.997707 23487 ts_tablet_manager.cc:1428] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc: Time spent starting tablet: real 0.075s user 0.029s sys 0.012s
I20260807 18:14:08.998581 23631 heartbeater.cc:347] Connected to a master server at 127.19.201.62:40147
I20260807 18:14:08.998739 23631 heartbeater.cc:464] Registering TS with master...
I20260807 18:14:08.999200 23631 heartbeater.cc:511] Master 127.19.201.62:40147 requested a full tablet report, sending...
I20260807 18:14:09.001497 23642 raft_consensus.cc:686] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [term 2 LEADER]: Becoming Leader. State: Replica: 28ae4bac80fa40119e626503bf0c48fc, State: Running, Role: LEADER
I20260807 18:14:09.002164 23642 consensus_queue.cc:237] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 36467 } }
I20260807 18:14:09.002507 23646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "deeb18b772244461b68ce43fb99bd2ff" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:09.002815 23646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:09.004545 23388 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [term 2 FOLLOWER]: Refusing update from remote peer deeb18b772244461b68ce43fb99bd2ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260807 18:14:09.005491 23643 consensus_queue.cc:1035] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 18:14:09.014654 23637 sys_catalog.cc:455] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "deeb18b772244461b68ce43fb99bd2ff" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:09.015179 23637 sys_catalog.cc:458] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: This master's current role is: LEADER
I20260807 18:14:09.022372 23661 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "deeb18b772244461b68ce43fb99bd2ff" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:09.022881 23661 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:09.023250 23653 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [sys.catalog]: SysCatalogTable state changed. Reason: New leader deeb18b772244461b68ce43fb99bd2ff. Latest consensus state: current_term: 2 leader_uuid: "deeb18b772244461b68ce43fb99bd2ff" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:09.023643 23653 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:09.024256 23377 ts_manager.cc:194] Registered new tserver with Master: 28ae4bac80fa40119e626503bf0c48fc (127.19.201.1:41029)
I20260807 18:14:09.025254 23172 ts_manager.cc:194] Registered new tserver with Master: 28ae4bac80fa40119e626503bf0c48fc (127.19.201.1:41029)
I20260807 18:14:09.025593 23276 ts_manager.cc:194] Registered new tserver with Master: 28ae4bac80fa40119e626503bf0c48fc (127.19.201.1:41029)
I20260807 18:14:09.026798 23172 catalog_manager.cc:5495] T 9eb3adcbd9864f3e807d2d496e55b8b3 P 28ae4bac80fa40119e626503bf0c48fc reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "28ae4bac80fa40119e626503bf0c48fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 36467 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:09.033182 20260 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20260807 18:14:09.038352 23643 sys_catalog.cc:455] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "deeb18b772244461b68ce43fb99bd2ff" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:09.038707 23643 sys_catalog.cc:458] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: This master's current role is: LEADER
I20260807 18:14:09.052573 23172 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.201.1:49303
I20260807 18:14:09.056245 23631 heartbeater.cc:503] Master 127.19.201.62:40147 was elected leader, sending a full tablet report...
I20260807 18:14:09.064988 20260 dynamic_multi_master-test.cc:680] Transferring leadership to master: e1aa121c9b6f4bb5af976f908b3d0463
I20260807 18:14:09.069682 23185 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "deeb18b772244461b68ce43fb99bd2ff"
mode: GRACEFUL
new_leader_uuid: "e1aa121c9b6f4bb5af976f908b3d0463"
from {username='slave'} at 127.0.0.1:53056
I20260807 18:14:09.070221 23185 raft_consensus.cc:595] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 2 LEADER]: Received request to transfer leadership to TS e1aa121c9b6f4bb5af976f908b3d0463
I20260807 18:14:09.632858 23668 raft_consensus.cc:979] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff: : Instructing follower e1aa121c9b6f4bb5af976f908b3d0463 to start an election
I20260807 18:14:09.633042 23668 raft_consensus.cc:1067] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 2 LEADER]: Signalling peer e1aa121c9b6f4bb5af976f908b3d0463 to start an election
I20260807 18:14:09.634107 23388 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "e1aa121c9b6f4bb5af976f908b3d0463"
from {username='slave'} at 127.0.0.1:40872
I20260807 18:14:09.634419 23388 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 18:14:09.634550 23388 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [term 2 FOLLOWER]: Advancing to term 3
I20260807 18:14:09.636473 23388 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } }
I20260807 18:14:09.638659 23388 leader_election.cc:288] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [CANDIDATE]: Term 3 election: Requested vote from peers deeb18b772244461b68ce43fb99bd2ff (127.19.201.62:40147), 672bcba6964843a19ce6805c9a7583c9 (127.19.201.61:40441)
I20260807 18:14:09.647703 23185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" candidate_term: 3 candidate_status { last_received { term: 2 index: 11 } } ignore_live_leader: true dest_uuid: "deeb18b772244461b68ce43fb99bd2ff"
I20260807 18:14:09.648102 23185 raft_consensus.cc:3032] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 2 LEADER]: Stepping down as leader of term 2
I20260807 18:14:09.648229 23185 raft_consensus.cc:729] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: deeb18b772244461b68ce43fb99bd2ff, State: Running, Role: LEADER
I20260807 18:14:09.648149 23290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" candidate_term: 3 candidate_status { last_received { term: 2 index: 11 } } ignore_live_leader: true dest_uuid: "672bcba6964843a19ce6805c9a7583c9"
I20260807 18:14:09.648391 23290 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 2 FOLLOWER]: Advancing to term 3
I20260807 18:14:09.648581 23185 consensus_queue.cc:260] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 2.11, Last appended by leader: 11, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } }
I20260807 18:14:09.649117 23185 raft_consensus.cc:3037] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 2 FOLLOWER]: Advancing to term 3
I20260807 18:14:09.650564 23290 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1aa121c9b6f4bb5af976f908b3d0463 in term 3.
I20260807 18:14:09.651316 23185 raft_consensus.cc:2454] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1aa121c9b6f4bb5af976f908b3d0463 in term 3.
I20260807 18:14:09.651331 23359 leader_election.cc:302] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 672bcba6964843a19ce6805c9a7583c9, e1aa121c9b6f4bb5af976f908b3d0463; no voters:
I20260807 18:14:09.652180 23675 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 18:14:09.652751 23675 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [term 3 LEADER]: Becoming Leader. State: Replica: e1aa121c9b6f4bb5af976f908b3d0463, State: Running, Role: LEADER
I20260807 18:14:09.653255 23675 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 2.11, Last appended by leader: 11, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } }
I20260807 18:14:09.654870 23676 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1aa121c9b6f4bb5af976f908b3d0463. Latest consensus state: current_term: 3 leader_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:09.655349 23676 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [sys.catalog]: This master's current role is: LEADER
I20260807 18:14:09.656066 23677 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:14:09.658766 23677 catalog_manager.cc:669] Loaded metadata for table first_table [id=c4630185368b45f797fd3fea2e131762]
I20260807 18:14:09.660400 23677 tablet_loader.cc:96] loaded metadata for tablet 9eb3adcbd9864f3e807d2d496e55b8b3 (table first_table [id=c4630185368b45f797fd3fea2e131762])
I20260807 18:14:09.660669 23677 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:14:09.661566 23677 catalog_manager.cc:1259] Loaded cluster ID: 62166a6dc0ca431ab9c288d87d3e425d
I20260807 18:14:09.661638 23677 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:14:09.662788 23677 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:14:09.663604 23677 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463: Loaded TSK: 0
I20260807 18:14:09.664453 23677 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:14:10.086588 23290 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 3 FOLLOWER]: Refusing update from remote peer e1aa121c9b6f4bb5af976f908b3d0463: Log matching property violated. Preceding OpId in replica: term: 2 index: 11. Preceding OpId from leader: term: 3 index: 12. (index mismatch)
I20260807 18:14:10.087417 23676 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [LEADER]: Connected to new peer: Peer: permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 18:14:10.089537 23678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1aa121c9b6f4bb5af976f908b3d0463. Latest consensus state: current_term: 3 leader_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:10.089874 23678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:10.091578 23675 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:10.091965 23675 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [sys.catalog]: This master's current role is: LEADER
I20260807 18:14:10.092787 23185 raft_consensus.cc:1261] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 3 FOLLOWER]: Refusing update from remote peer e1aa121c9b6f4bb5af976f908b3d0463: Log matching property violated. Preceding OpId in replica: term: 2 index: 11. Preceding OpId from leader: term: 3 index: 12. (index mismatch)
I20260807 18:14:10.092785 23678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:10.093036 23678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:10.093716 23675 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 18:14:10.095925 23637 sys_catalog.cc:455] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:10.096264 23637 sys_catalog.cc:458] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:10.096232 23668 sys_catalog.cc:455] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1aa121c9b6f4bb5af976f908b3d0463. Latest consensus state: current_term: 3 leader_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:10.096498 23668 sys_catalog.cc:458] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:10.287448 23546 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
672bcba6964843a19ce6805c9a7583c9 | 127.19.201.61:40441 | HEALTHY
deeb18b772244461b68ce43fb99bd2ff | 127.19.201.62:40147 | HEALTHY
e1aa121c9b6f4bb5af976f908b3d0463 | 127.19.201.60:42911 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 3 server(s) checked
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_reuseport | true | experimental | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb | hidden | 127.19.201.62:40147
server_dump_info_path | /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb | hidden | 127.19.201.61:40441
server_dump_info_path | /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/master-2/data/info.pb | hidden | 127.19.201.60:42911
tsk_num_rsa_bits | 512 | experimental | all 3 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.19.201.20:38679 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
28ae4bac80fa40119e626503bf0c48fc | 127.19.201.1:41029 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 1
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
local_ip_for_outbound_sockets | 127.19.201.1 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL_2.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb | hidden | all 1 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.19.201.20:38679 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-------------+----+---------+---------------+---------+------------+------------------+-------------
first_table | 1 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 3
Tablet Servers | 1
Tables | 1
Tablets | 1
Replicas | 1
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260807 18:14:10.326612 20260 log_verifier.cc:126] Checking tablet 9eb3adcbd9864f3e807d2d496e55b8b3
I20260807 18:14:10.344461 20260 log_verifier.cc:177] Verified matching terms for 2 ops in tablet 9eb3adcbd9864f3e807d2d496e55b8b3
I20260807 18:14:10.344715 20260 dynamic_multi_master-test.cc:688] Verifying the first table
I20260807 18:14:10.385018 20260 dynamic_multi_master-test.cc:691] Creating and verifying the second table
I20260807 18:14:10.402287 23376 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40926:
name: "second_table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:10.407953 23675 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:10.408324 23675 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [sys.catalog]: This master's current role is: LEADER
I20260807 18:14:10.435588 23546 tablet_service.cc:1467] Processing CreateTablet for tablet 5e9849e97c5743bf8627ec81101fa14c (DEFAULT_TABLE table=second_table [id=2dff2942a1d942ca9d7692c3c0e74f04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:10.436661 23546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e9849e97c5743bf8627ec81101fa14c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:10.445881 23761 tablet_bootstrap.cc:492] T 5e9849e97c5743bf8627ec81101fa14c P 28ae4bac80fa40119e626503bf0c48fc: Bootstrap starting.
I20260807 18:14:10.447755 23761 tablet_bootstrap.cc:654] T 5e9849e97c5743bf8627ec81101fa14c P 28ae4bac80fa40119e626503bf0c48fc: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:10.450084 23761 tablet_bootstrap.cc:492] T 5e9849e97c5743bf8627ec81101fa14c P 28ae4bac80fa40119e626503bf0c48fc: No bootstrap required, opened a new log
I20260807 18:14:10.450242 23761 ts_tablet_manager.cc:1397] T 5e9849e97c5743bf8627ec81101fa14c P 28ae4bac80fa40119e626503bf0c48fc: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260807 18:14:10.451416 23761 raft_consensus.cc:348] T 5e9849e97c5743bf8627ec81101fa14c P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 41029 } }
I20260807 18:14:10.451819 23761 raft_consensus.cc:374] T 5e9849e97c5743bf8627ec81101fa14c P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:10.451967 23761 raft_consensus.cc:729] T 5e9849e97c5743bf8627ec81101fa14c P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28ae4bac80fa40119e626503bf0c48fc, State: Initialized, Role: FOLLOWER
I20260807 18:14:10.452255 23761 consensus_queue.cc:260] T 5e9849e97c5743bf8627ec81101fa14c P 28ae4bac80fa40119e626503bf0c48fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 41029 } }
I20260807 18:14:10.452518 23761 raft_consensus.cc:388] T 5e9849e97c5743bf8627ec81101fa14c P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:10.452631 23761 raft_consensus.cc:482] T 5e9849e97c5743bf8627ec81101fa14c P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:10.452823 23761 raft_consensus.cc:3037] T 5e9849e97c5743bf8627ec81101fa14c P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:10.454923 23761 raft_consensus.cc:504] T 5e9849e97c5743bf8627ec81101fa14c P 28ae4bac80fa40119e626503bf0c48fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 41029 } }
I20260807 18:14:10.455199 23761 leader_election.cc:302] T 5e9849e97c5743bf8627ec81101fa14c P 28ae4bac80fa40119e626503bf0c48fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 28ae4bac80fa40119e626503bf0c48fc; no voters:
I20260807 18:14:10.455760 23761 leader_election.cc:288] T 5e9849e97c5743bf8627ec81101fa14c P 28ae4bac80fa40119e626503bf0c48fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:10.455924 23764 raft_consensus.cc:2781] T 5e9849e97c5743bf8627ec81101fa14c P 28ae4bac80fa40119e626503bf0c48fc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:10.457870 23629 heartbeater.cc:503] Master 127.19.201.60:42911 was elected leader, sending a full tablet report...
I20260807 18:14:10.458000 23761 ts_tablet_manager.cc:1428] T 5e9849e97c5743bf8627ec81101fa14c P 28ae4bac80fa40119e626503bf0c48fc: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20260807 18:14:10.458534 23764 raft_consensus.cc:686] T 5e9849e97c5743bf8627ec81101fa14c P 28ae4bac80fa40119e626503bf0c48fc [term 1 LEADER]: Becoming Leader. State: Replica: 28ae4bac80fa40119e626503bf0c48fc, State: Running, Role: LEADER
I20260807 18:14:10.458947 23764 consensus_queue.cc:237] T 5e9849e97c5743bf8627ec81101fa14c P 28ae4bac80fa40119e626503bf0c48fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 41029 } }
I20260807 18:14:10.462649 23377 catalog_manager.cc:5495] T 5e9849e97c5743bf8627ec81101fa14c P 28ae4bac80fa40119e626503bf0c48fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 28ae4bac80fa40119e626503bf0c48fc (127.19.201.1). New cstate: current_term: 1 leader_uuid: "28ae4bac80fa40119e626503bf0c48fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 41029 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:10.521095 20260 dynamic_multi_master-test.cc:700] Pausing and resuming individual masters
I20260807 18:14:10.521217 20260 dynamic_multi_master-test.cc:704] Pausing master deeb18b772244461b68ce43fb99bd2ff, 127.19.201.62:40147
I20260807 18:14:10.568791 23377 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40948:
name: "table-0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:10.580932 23546 tablet_service.cc:1467] Processing CreateTablet for tablet 0d291503f2b94e569fe454ce6ec6b345 (DEFAULT_TABLE table=table-0 [id=355ef08ab12f44189506ce71aaeec59c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:10.581615 23546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d291503f2b94e569fe454ce6ec6b345. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:10.586553 23761 tablet_bootstrap.cc:492] T 0d291503f2b94e569fe454ce6ec6b345 P 28ae4bac80fa40119e626503bf0c48fc: Bootstrap starting.
I20260807 18:14:10.588248 23761 tablet_bootstrap.cc:654] T 0d291503f2b94e569fe454ce6ec6b345 P 28ae4bac80fa40119e626503bf0c48fc: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:10.590870 23761 tablet_bootstrap.cc:492] T 0d291503f2b94e569fe454ce6ec6b345 P 28ae4bac80fa40119e626503bf0c48fc: No bootstrap required, opened a new log
I20260807 18:14:10.591051 23761 ts_tablet_manager.cc:1397] T 0d291503f2b94e569fe454ce6ec6b345 P 28ae4bac80fa40119e626503bf0c48fc: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s
I20260807 18:14:10.591743 23761 raft_consensus.cc:348] T 0d291503f2b94e569fe454ce6ec6b345 P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 41029 } }
I20260807 18:14:10.591958 23761 raft_consensus.cc:374] T 0d291503f2b94e569fe454ce6ec6b345 P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:10.592044 23761 raft_consensus.cc:729] T 0d291503f2b94e569fe454ce6ec6b345 P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28ae4bac80fa40119e626503bf0c48fc, State: Initialized, Role: FOLLOWER
I20260807 18:14:10.592325 23761 consensus_queue.cc:260] T 0d291503f2b94e569fe454ce6ec6b345 P 28ae4bac80fa40119e626503bf0c48fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 41029 } }
I20260807 18:14:10.592517 23761 raft_consensus.cc:388] T 0d291503f2b94e569fe454ce6ec6b345 P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:10.592629 23761 raft_consensus.cc:482] T 0d291503f2b94e569fe454ce6ec6b345 P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:10.592744 23761 raft_consensus.cc:3037] T 0d291503f2b94e569fe454ce6ec6b345 P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:10.595255 23761 raft_consensus.cc:504] T 0d291503f2b94e569fe454ce6ec6b345 P 28ae4bac80fa40119e626503bf0c48fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 41029 } }
I20260807 18:14:10.595542 23761 leader_election.cc:302] T 0d291503f2b94e569fe454ce6ec6b345 P 28ae4bac80fa40119e626503bf0c48fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 28ae4bac80fa40119e626503bf0c48fc; no voters:
I20260807 18:14:10.595746 23761 leader_election.cc:288] T 0d291503f2b94e569fe454ce6ec6b345 P 28ae4bac80fa40119e626503bf0c48fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:10.595827 23764 raft_consensus.cc:2781] T 0d291503f2b94e569fe454ce6ec6b345 P 28ae4bac80fa40119e626503bf0c48fc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:10.596032 23764 raft_consensus.cc:686] T 0d291503f2b94e569fe454ce6ec6b345 P 28ae4bac80fa40119e626503bf0c48fc [term 1 LEADER]: Becoming Leader. State: Replica: 28ae4bac80fa40119e626503bf0c48fc, State: Running, Role: LEADER
I20260807 18:14:10.596251 23764 consensus_queue.cc:237] T 0d291503f2b94e569fe454ce6ec6b345 P 28ae4bac80fa40119e626503bf0c48fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 41029 } }
I20260807 18:14:10.596472 23761 ts_tablet_manager.cc:1428] T 0d291503f2b94e569fe454ce6ec6b345 P 28ae4bac80fa40119e626503bf0c48fc: Time spent starting tablet: real 0.005s user 0.000s sys 0.006s
I20260807 18:14:10.600939 23377 catalog_manager.cc:5495] T 0d291503f2b94e569fe454ce6ec6b345 P 28ae4bac80fa40119e626503bf0c48fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 28ae4bac80fa40119e626503bf0c48fc (127.19.201.1). New cstate: current_term: 1 leader_uuid: "28ae4bac80fa40119e626503bf0c48fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 41029 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:10.609413 20260 dynamic_multi_master-test.cc:704] Pausing master 672bcba6964843a19ce6805c9a7583c9, 127.19.201.61:40441
I20260807 18:14:10.673547 23377 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40964:
name: "table-1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:10.686399 23546 tablet_service.cc:1467] Processing CreateTablet for tablet 3138e9f91f124f8bbead0a078403d9f8 (DEFAULT_TABLE table=table-1 [id=4a89aefbcc5d4035b4458e0087239446]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:10.687049 23546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3138e9f91f124f8bbead0a078403d9f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:10.694885 23761 tablet_bootstrap.cc:492] T 3138e9f91f124f8bbead0a078403d9f8 P 28ae4bac80fa40119e626503bf0c48fc: Bootstrap starting.
I20260807 18:14:10.696507 23761 tablet_bootstrap.cc:654] T 3138e9f91f124f8bbead0a078403d9f8 P 28ae4bac80fa40119e626503bf0c48fc: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:10.699148 23761 tablet_bootstrap.cc:492] T 3138e9f91f124f8bbead0a078403d9f8 P 28ae4bac80fa40119e626503bf0c48fc: No bootstrap required, opened a new log
I20260807 18:14:10.699319 23761 ts_tablet_manager.cc:1397] T 3138e9f91f124f8bbead0a078403d9f8 P 28ae4bac80fa40119e626503bf0c48fc: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260807 18:14:10.700095 23761 raft_consensus.cc:348] T 3138e9f91f124f8bbead0a078403d9f8 P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 41029 } }
I20260807 18:14:10.700297 23761 raft_consensus.cc:374] T 3138e9f91f124f8bbead0a078403d9f8 P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:10.700457 23761 raft_consensus.cc:729] T 3138e9f91f124f8bbead0a078403d9f8 P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28ae4bac80fa40119e626503bf0c48fc, State: Initialized, Role: FOLLOWER
I20260807 18:14:10.700716 23761 consensus_queue.cc:260] T 3138e9f91f124f8bbead0a078403d9f8 P 28ae4bac80fa40119e626503bf0c48fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 41029 } }
I20260807 18:14:10.700933 23761 raft_consensus.cc:388] T 3138e9f91f124f8bbead0a078403d9f8 P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:10.701066 23761 raft_consensus.cc:482] T 3138e9f91f124f8bbead0a078403d9f8 P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:10.701251 23761 raft_consensus.cc:3037] T 3138e9f91f124f8bbead0a078403d9f8 P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:10.704097 23761 raft_consensus.cc:504] T 3138e9f91f124f8bbead0a078403d9f8 P 28ae4bac80fa40119e626503bf0c48fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 41029 } }
I20260807 18:14:10.704376 23761 leader_election.cc:302] T 3138e9f91f124f8bbead0a078403d9f8 P 28ae4bac80fa40119e626503bf0c48fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 28ae4bac80fa40119e626503bf0c48fc; no voters:
I20260807 18:14:10.704593 23761 leader_election.cc:288] T 3138e9f91f124f8bbead0a078403d9f8 P 28ae4bac80fa40119e626503bf0c48fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:10.704744 23764 raft_consensus.cc:2781] T 3138e9f91f124f8bbead0a078403d9f8 P 28ae4bac80fa40119e626503bf0c48fc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:10.704936 23764 raft_consensus.cc:686] T 3138e9f91f124f8bbead0a078403d9f8 P 28ae4bac80fa40119e626503bf0c48fc [term 1 LEADER]: Becoming Leader. State: Replica: 28ae4bac80fa40119e626503bf0c48fc, State: Running, Role: LEADER
I20260807 18:14:10.705175 23761 ts_tablet_manager.cc:1428] T 3138e9f91f124f8bbead0a078403d9f8 P 28ae4bac80fa40119e626503bf0c48fc: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260807 18:14:10.705276 23764 consensus_queue.cc:237] T 3138e9f91f124f8bbead0a078403d9f8 P 28ae4bac80fa40119e626503bf0c48fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 41029 } }
I20260807 18:14:10.708666 23377 catalog_manager.cc:5495] T 3138e9f91f124f8bbead0a078403d9f8 P 28ae4bac80fa40119e626503bf0c48fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 28ae4bac80fa40119e626503bf0c48fc (127.19.201.1). New cstate: current_term: 1 leader_uuid: "28ae4bac80fa40119e626503bf0c48fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 41029 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:10.718154 20260 dynamic_multi_master-test.cc:704] Pausing master e1aa121c9b6f4bb5af976f908b3d0463, 127.19.201.60:42911
I20260807 18:14:12.215154 23842 raft_consensus.cc:482] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e1aa121c9b6f4bb5af976f908b3d0463)
I20260807 18:14:12.215409 23842 raft_consensus.cc:504] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } }
I20260807 18:14:12.216146 23842 leader_election.cc:288] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 672bcba6964843a19ce6805c9a7583c9 (127.19.201.61:40441), e1aa121c9b6f4bb5af976f908b3d0463 (127.19.201.60:42911)
I20260807 18:14:12.216791 23290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "deeb18b772244461b68ce43fb99bd2ff" candidate_term: 4 candidate_status { last_received { term: 3 index: 21 } } ignore_live_leader: false dest_uuid: "672bcba6964843a19ce6805c9a7583c9" is_pre_election: true
I20260807 18:14:12.223024 23843 raft_consensus.cc:482] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e1aa121c9b6f4bb5af976f908b3d0463)
I20260807 18:14:12.223235 23843 raft_consensus.cc:504] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } }
I20260807 18:14:12.225404 23843 leader_election.cc:288] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers deeb18b772244461b68ce43fb99bd2ff (127.19.201.62:40147), e1aa121c9b6f4bb5af976f908b3d0463 (127.19.201.60:42911)
I20260807 18:14:12.233070 23184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "672bcba6964843a19ce6805c9a7583c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 19 } } ignore_live_leader: false dest_uuid: "deeb18b772244461b68ce43fb99bd2ff" is_pre_election: true
I20260807 18:14:12.233498 23184 raft_consensus.cc:2396] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 672bcba6964843a19ce6805c9a7583c9 for term 4 because replica has last-logged OpId of term: 3 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 19.
W20260807 18:14:13.799437 23837 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:14:10.734796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.201.60:42911 (local address 127.0.0.1:40970)
0807 18:14:10.735837 (+ 1041us) negotiation.cc:107] Waiting for socket to connect
0807 18:14:10.735861 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 18:14:10.735992 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:14:13.797886 (+3061894us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.19.201.60:42911: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":873,"thread_start_us":2669,"threads_started":1}
W20260807 18:14:13.979329 23156 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.201.60:42911 timed out after 1.762s (SENT)
W20260807 18:14:14.123787 23263 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: connection negotiation to 127.19.201.60:42911 for RPC RequestConsensusVote timed out after 1.897s (ON_OUTBOUND_QUEUE)
W20260807 18:14:15.334728 23845 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:14:12.225780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.201.60:42911 (local address 127.0.0.1:40980)
0807 18:14:12.226468 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0807 18:14:12.226514 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 18:14:12.226717 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:14:15.333796 (+3107079us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.19.201.60:42911: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":999,"threads_started":1}
W20260807 18:14:15.335048 23263 leader_election.cc:334] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e1aa121c9b6f4bb5af976f908b3d0463 (127.19.201.60:42911): Timed out: Client connection negotiation failed: client connection to 127.19.201.60:42911: received 0 of 4 requested bytes
I20260807 18:14:15.335220 23263 leader_election.cc:302] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 672bcba6964843a19ce6805c9a7583c9; no voters: deeb18b772244461b68ce43fb99bd2ff, e1aa121c9b6f4bb5af976f908b3d0463
I20260807 18:14:15.335879 23849 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 18:14:15.743850 23156 leader_election.cc:334] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e1aa121c9b6f4bb5af976f908b3d0463 (127.19.201.60:42911): Timed out: RequestConsensusVote RPC to 127.19.201.60:42911 timed out after 1.762s (SENT)
I20260807 18:14:15.744037 23156 leader_election.cc:302] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: deeb18b772244461b68ce43fb99bd2ff; no voters: 672bcba6964843a19ce6805c9a7583c9, e1aa121c9b6f4bb5af976f908b3d0463
I20260807 18:14:15.744747 23850 raft_consensus.cc:2726] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 18:14:16.869978 23837 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:14:13.801647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.201.60:42911 (local address 127.0.0.1:47588)
0807 18:14:13.801900 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0807 18:14:13.801923 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 18:14:13.802047 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:14:16.869759 (+3067712us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.19.201.60:42911: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":89}
I20260807 18:14:17.382481 23851 raft_consensus.cc:482] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e1aa121c9b6f4bb5af976f908b3d0463)
I20260807 18:14:17.382750 23851 raft_consensus.cc:504] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } }
I20260807 18:14:17.383474 23851 leader_election.cc:288] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 672bcba6964843a19ce6805c9a7583c9 (127.19.201.61:40441), e1aa121c9b6f4bb5af976f908b3d0463 (127.19.201.60:42911)
I20260807 18:14:17.384094 23290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "deeb18b772244461b68ce43fb99bd2ff" candidate_term: 4 candidate_status { last_received { term: 3 index: 21 } } ignore_live_leader: false dest_uuid: "672bcba6964843a19ce6805c9a7583c9" is_pre_election: true
I20260807 18:14:17.384358 23290 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deeb18b772244461b68ce43fb99bd2ff in term 3.
I20260807 18:14:17.384881 23153 leader_election.cc:302] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 672bcba6964843a19ce6805c9a7583c9, deeb18b772244461b68ce43fb99bd2ff; no voters:
I20260807 18:14:17.385159 23851 raft_consensus.cc:2781] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 18:14:17.385267 23851 raft_consensus.cc:482] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 3 FOLLOWER]: Starting leader election (detected failure of leader e1aa121c9b6f4bb5af976f908b3d0463)
I20260807 18:14:17.385377 23851 raft_consensus.cc:3037] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 3 FOLLOWER]: Advancing to term 4
I20260807 18:14:17.387413 23851 raft_consensus.cc:504] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 4 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } }
I20260807 18:14:17.388034 23851 leader_election.cc:288] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [CANDIDATE]: Term 4 election: Requested vote from peers 672bcba6964843a19ce6805c9a7583c9 (127.19.201.61:40441), e1aa121c9b6f4bb5af976f908b3d0463 (127.19.201.60:42911)
I20260807 18:14:17.388484 23290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "deeb18b772244461b68ce43fb99bd2ff" candidate_term: 4 candidate_status { last_received { term: 3 index: 21 } } ignore_live_leader: false dest_uuid: "672bcba6964843a19ce6805c9a7583c9"
I20260807 18:14:17.388756 23290 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 3 FOLLOWER]: Advancing to term 4
I20260807 18:14:17.390718 23290 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deeb18b772244461b68ce43fb99bd2ff in term 4.
I20260807 18:14:17.391252 23153 leader_election.cc:302] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 672bcba6964843a19ce6805c9a7583c9, deeb18b772244461b68ce43fb99bd2ff; no voters:
I20260807 18:14:17.391650 23851 raft_consensus.cc:2781] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 4 FOLLOWER]: Leader election won for term 4
I20260807 18:14:17.392031 23851 raft_consensus.cc:686] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 4 LEADER]: Becoming Leader. State: Replica: deeb18b772244461b68ce43fb99bd2ff, State: Running, Role: LEADER
I20260807 18:14:17.392361 23851 consensus_queue.cc:237] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 3.21, Last appended by leader: 21, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } }
I20260807 18:14:17.393635 23852 sys_catalog.cc:455] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader deeb18b772244461b68ce43fb99bd2ff. Latest consensus state: current_term: 4 leader_uuid: "deeb18b772244461b68ce43fb99bd2ff" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:17.394049 23852 sys_catalog.cc:458] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: This master's current role is: LEADER
I20260807 18:14:17.394610 23854 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:14:17.396124 23854 catalog_manager.cc:669] Loaded metadata for table second_table [id=2dff2942a1d942ca9d7692c3c0e74f04]
I20260807 18:14:17.396519 23854 catalog_manager.cc:669] Loaded metadata for table table-0 [id=355ef08ab12f44189506ce71aaeec59c]
I20260807 18:14:17.396865 23854 catalog_manager.cc:669] Loaded metadata for table table-1 [id=4a89aefbcc5d4035b4458e0087239446]
I20260807 18:14:17.397203 23854 catalog_manager.cc:669] Loaded metadata for table first_table [id=c4630185368b45f797fd3fea2e131762]
I20260807 18:14:17.398331 23854 tablet_loader.cc:96] loaded metadata for tablet 0d291503f2b94e569fe454ce6ec6b345 (table table-0 [id=355ef08ab12f44189506ce71aaeec59c])
I20260807 18:14:17.398665 23854 tablet_loader.cc:96] loaded metadata for tablet 3138e9f91f124f8bbead0a078403d9f8 (table table-1 [id=4a89aefbcc5d4035b4458e0087239446])
I20260807 18:14:17.398960 23854 tablet_loader.cc:96] loaded metadata for tablet 5e9849e97c5743bf8627ec81101fa14c (table second_table [id=2dff2942a1d942ca9d7692c3c0e74f04])
I20260807 18:14:17.399274 23854 tablet_loader.cc:96] loaded metadata for tablet 9eb3adcbd9864f3e807d2d496e55b8b3 (table first_table [id=c4630185368b45f797fd3fea2e131762])
I20260807 18:14:17.399624 23854 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:14:17.400452 23854 catalog_manager.cc:1259] Loaded cluster ID: 62166a6dc0ca431ab9c288d87d3e425d
I20260807 18:14:17.400527 23854 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:14:17.401772 23854 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:14:17.402596 23854 catalog_manager.cc:5879] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff: Loaded TSK: 0
I20260807 18:14:17.403110 23854 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:14:17.854030 23290 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 4 FOLLOWER]: Refusing update from remote peer deeb18b772244461b68ce43fb99bd2ff: Log matching property violated. Preceding OpId in replica: term: 3 index: 19. Preceding OpId from leader: term: 4 index: 22. (index mismatch)
I20260807 18:14:17.854790 23852 consensus_queue.cc:1035] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 18, Time since last communication: 0.000s
I20260807 18:14:17.858657 23856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader deeb18b772244461b68ce43fb99bd2ff. Latest consensus state: current_term: 4 leader_uuid: "deeb18b772244461b68ce43fb99bd2ff" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:17.859280 23856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:17.860713 23851 sys_catalog.cc:455] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "deeb18b772244461b68ce43fb99bd2ff" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:17.861053 23851 sys_catalog.cc:458] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [sys.catalog]: This master's current role is: LEADER
I20260807 18:14:17.861030 23856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "deeb18b772244461b68ce43fb99bd2ff" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:17.861310 23856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:18.727630 23631 heartbeater.cc:503] Master 127.19.201.62:40147 was elected leader, sending a full tablet report...
W20260807 18:14:19.513052 23156 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.201.60:42911 timed out after 2.128s (SENT)
W20260807 18:14:19.941988 23837 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:14:16.874268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.201.60:42911 (local address 127.0.0.1:47596)
0807 18:14:16.874492 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0807 18:14:16.874515 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 18:14:16.874663 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:14:19.941706 (+3067043us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.19.201.60:42911: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":74}
I20260807 18:14:19.989827 23171 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38754:
name: "table-2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:20.025624 23546 tablet_service.cc:1467] Processing CreateTablet for tablet 8dd25548586b47cdb75038342468a0c9 (DEFAULT_TABLE table=table-2 [id=33f9a030fb0042da99ebd2b3e35d24f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:20.026254 23546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dd25548586b47cdb75038342468a0c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:20.033964 23892 tablet_bootstrap.cc:492] T 8dd25548586b47cdb75038342468a0c9 P 28ae4bac80fa40119e626503bf0c48fc: Bootstrap starting.
I20260807 18:14:20.036839 23892 tablet_bootstrap.cc:654] T 8dd25548586b47cdb75038342468a0c9 P 28ae4bac80fa40119e626503bf0c48fc: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:20.040477 23892 tablet_bootstrap.cc:492] T 8dd25548586b47cdb75038342468a0c9 P 28ae4bac80fa40119e626503bf0c48fc: No bootstrap required, opened a new log
I20260807 18:14:20.040719 23892 ts_tablet_manager.cc:1397] T 8dd25548586b47cdb75038342468a0c9 P 28ae4bac80fa40119e626503bf0c48fc: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.003s
I20260807 18:14:20.042055 23892 raft_consensus.cc:348] T 8dd25548586b47cdb75038342468a0c9 P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 41029 } }
I20260807 18:14:20.042505 23892 raft_consensus.cc:374] T 8dd25548586b47cdb75038342468a0c9 P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:20.042786 23892 raft_consensus.cc:729] T 8dd25548586b47cdb75038342468a0c9 P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28ae4bac80fa40119e626503bf0c48fc, State: Initialized, Role: FOLLOWER
I20260807 18:14:20.043082 23892 consensus_queue.cc:260] T 8dd25548586b47cdb75038342468a0c9 P 28ae4bac80fa40119e626503bf0c48fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 41029 } }
I20260807 18:14:20.043430 23892 raft_consensus.cc:388] T 8dd25548586b47cdb75038342468a0c9 P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:20.043619 23892 raft_consensus.cc:482] T 8dd25548586b47cdb75038342468a0c9 P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:20.043877 23892 raft_consensus.cc:3037] T 8dd25548586b47cdb75038342468a0c9 P 28ae4bac80fa40119e626503bf0c48fc [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:20.046864 23892 raft_consensus.cc:504] T 8dd25548586b47cdb75038342468a0c9 P 28ae4bac80fa40119e626503bf0c48fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 41029 } }
I20260807 18:14:20.047197 23892 leader_election.cc:302] T 8dd25548586b47cdb75038342468a0c9 P 28ae4bac80fa40119e626503bf0c48fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 28ae4bac80fa40119e626503bf0c48fc; no voters:
I20260807 18:14:20.047992 23892 leader_election.cc:288] T 8dd25548586b47cdb75038342468a0c9 P 28ae4bac80fa40119e626503bf0c48fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:20.048337 23894 raft_consensus.cc:2781] T 8dd25548586b47cdb75038342468a0c9 P 28ae4bac80fa40119e626503bf0c48fc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:20.049854 23892 ts_tablet_manager.cc:1428] T 8dd25548586b47cdb75038342468a0c9 P 28ae4bac80fa40119e626503bf0c48fc: Time spent starting tablet: real 0.009s user 0.001s sys 0.009s
I20260807 18:14:20.050540 23894 raft_consensus.cc:686] T 8dd25548586b47cdb75038342468a0c9 P 28ae4bac80fa40119e626503bf0c48fc [term 1 LEADER]: Becoming Leader. State: Replica: 28ae4bac80fa40119e626503bf0c48fc, State: Running, Role: LEADER
I20260807 18:14:20.050998 23894 consensus_queue.cc:237] T 8dd25548586b47cdb75038342468a0c9 P 28ae4bac80fa40119e626503bf0c48fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 41029 } }
I20260807 18:14:20.055124 23171 catalog_manager.cc:5495] T 8dd25548586b47cdb75038342468a0c9 P 28ae4bac80fa40119e626503bf0c48fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 28ae4bac80fa40119e626503bf0c48fc (127.19.201.1). New cstate: current_term: 1 leader_uuid: "28ae4bac80fa40119e626503bf0c48fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ae4bac80fa40119e626503bf0c48fc" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 41029 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:20.070952 20260 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskorkq8y/build/asan/bin/kudu pid 23460
I20260807 18:14:20.071816 23388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "deeb18b772244461b68ce43fb99bd2ff" candidate_term: 4 candidate_status { last_received { term: 3 index: 21 } } ignore_live_leader: false dest_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" is_pre_election: true
I20260807 18:14:20.073797 23387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "deeb18b772244461b68ce43fb99bd2ff" candidate_term: 4 candidate_status { last_received { term: 3 index: 21 } } ignore_live_leader: false dest_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" is_pre_election: true
I20260807 18:14:20.075299 23377 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.19.201.1:60649 (request call id 8) took 9357 ms. Trace:
I20260807 18:14:20.075567 23377 rpcz_store.cc:276] 0807 18:14:10.717487 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 18:14:10.717551 (+ 64us) service_pool.cc:227] Handling call
0807 18:14:20.075110 (+9357559us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":1}
I20260807 18:14:20.076541 23385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "deeb18b772244461b68ce43fb99bd2ff" candidate_term: 4 candidate_status { last_received { term: 3 index: 21 } } ignore_live_leader: false dest_uuid: "e1aa121c9b6f4bb5af976f908b3d0463"
I20260807 18:14:20.077399 23384 raft_consensus.cc:3032] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 18:14:20.077606 23384 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e1aa121c9b6f4bb5af976f908b3d0463, State: Running, Role: LEADER
I20260807 18:14:20.078159 23384 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 3.21, Last appended by leader: 21, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } }
I20260807 18:14:20.078944 23384 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [term 3 FOLLOWER]: Advancing to term 4
I20260807 18:14:20.082360 23382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "deeb18b772244461b68ce43fb99bd2ff" candidate_term: 4 candidate_status { last_received { term: 3 index: 21 } } ignore_live_leader: false dest_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" is_pre_election: true
I20260807 18:14:20.083695 23290 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 4 FOLLOWER]: Deduplicated request from leader. Original: 3.19->[3.20-3.21] Dedup: 3.21->[]
I20260807 18:14:20.084170 23290 raft_consensus.cc:1226] T 00000000000000000000000000000000 P 672bcba6964843a19ce6805c9a7583c9 [term 4 FOLLOWER]: Rejecting Update request from peer e1aa121c9b6f4bb5af976f908b3d0463 for earlier term 3. Current term is 4. Ops: [3.20-3.21]
I20260807 18:14:20.083526 23386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "deeb18b772244461b68ce43fb99bd2ff" candidate_term: 4 candidate_status { last_received { term: 3 index: 21 } } ignore_live_leader: false dest_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" is_pre_election: true
W20260807 18:14:20.085511 23691 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:14:20.072890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40980 (local address 127.19.201.60:42911)
0807 18:14:20.074841 (+ 1951us) server_negotiation.cc:206] Beginning negotiation
0807 18:14:20.074847 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:14:20.074866 (+ 19us) server_negotiation.cc:407] Connection header received
0807 18:14:20.074937 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:14:20.074943 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:14:20.075029 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:14:20.075301 (+ 272us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40980: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":1839}
W20260807 18:14:20.086582 23691 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:14:20.073085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47588 (local address 127.19.201.60:42911)
0807 18:14:20.085802 (+ 12717us) server_negotiation.cc:206] Beginning negotiation
0807 18:14:20.085809 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:14:20.085832 (+ 23us) server_negotiation.cc:407] Connection header received
0807 18:14:20.085890 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:14:20.085896 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:14:20.085981 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:14:20.086179 (+ 198us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47588: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":12597,"threads_started":1}
I20260807 18:14:20.087965 23184 raft_consensus.cc:1226] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [term 4 LEADER]: Rejecting Update request from peer e1aa121c9b6f4bb5af976f908b3d0463 for earlier term 3. Current term is 4. Ops: []
I20260807 18:14:20.094831 23384 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [term 4 FOLLOWER]: Refusing update from remote peer deeb18b772244461b68ce43fb99bd2ff: Log matching property violated. Preceding OpId in replica: term: 3 index: 21. Preceding OpId from leader: term: 4 index: 22. (index mismatch)
W20260807 18:14:20.104204 23691 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:14:20.074110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40970 (local address 127.19.201.60:42911)
0807 18:14:20.103293 (+ 29183us) server_negotiation.cc:206] Beginning negotiation
0807 18:14:20.103299 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:14:20.103318 (+ 19us) server_negotiation.cc:407] Connection header received
0807 18:14:20.103368 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:14:20.103373 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:14:20.103470 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:14:20.103784 (+ 314us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40970: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":29027,"threads_started":1}
W20260807 18:14:20.111109 23904 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:14:20.109388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47596 (local address 127.19.201.60:42911)
0807 18:14:20.109679 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0807 18:14:20.109686 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:14:20.109748 (+ 62us) server_negotiation.cc:407] Connection header received
0807 18:14:20.109802 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:14:20.109807 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:14:20.109945 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:14:20.110383 (+ 438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47596: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 18:14:20.111625 23882 consensus_queue.cc:1035] T 00000000000000000000000000000000 P deeb18b772244461b68ce43fb99bd2ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260807 18:14:20.123238 23624 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 18:14:20.135839 23676 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "deeb18b772244461b68ce43fb99bd2ff" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:20.136273 23676 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:20.137084 23756 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [sys.catalog]: SysCatalogTable state changed. Reason: New leader deeb18b772244461b68ce43fb99bd2ff. Latest consensus state: current_term: 4 leader_uuid: "deeb18b772244461b68ce43fb99bd2ff" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "deeb18b772244461b68ce43fb99bd2ff" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 40147 } } peers { permanent_uuid: "672bcba6964843a19ce6805c9a7583c9" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 40441 } } peers { permanent_uuid: "e1aa121c9b6f4bb5af976f908b3d0463" member_type: VOTER last_known_addr { host: "127.19.201.60" port: 42911 } attrs { promote: false } } }
I20260807 18:14:20.137867 23756 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1aa121c9b6f4bb5af976f908b3d0463 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:20.140813 23907 mvcc.cc:205] Tried to move back new op lower bound from 7315973980393742336 to 7315973969481129984. Current Snapshot: MvccSnapshot[applied={T|T < 7315973980393742336}]
I20260807 18:14:20.262859 20260 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskorkq8y/build/asan/bin/kudu with pid 23460
I20260807 18:14:20.297529 20260 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskorkq8y/build/asan/bin/kudu pid 23134
I20260807 18:14:20.298979 23213 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 18:14:20.418171 20260 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskorkq8y/build/asan/bin/kudu with pid 23134
I20260807 18:14:20.449507 20260 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskorkq8y/build/asan/bin/kudu pid 23223
I20260807 18:14:20.450699 23316 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 18:14:20.564968 20260 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskorkq8y/build/asan/bin/kudu with pid 23223
I20260807 18:14:20.596567 20260 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskorkq8y/build/asan/bin/kudu pid 23323
I20260807 18:14:20.597807 23417 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 18:14:20.715445 20260 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskorkq8y/build/asan/bin/kudu with pid 23323
2026-08-07T18:14:20Z chronyd exiting
[ OK ] ParameterizedAddMasterTest.TestAddMasterCatchupFromWAL/2 (20236 ms)
[----------] 1 test from ParameterizedAddMasterTest (20236 ms total)
[----------] 1 test from ParameterizedRemoveMasterTest
[ RUN ] ParameterizedRemoveMasterTest.TestRemoveMaster/0
2026-08-07T18:14:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:14:20Z Disabled control of system clock
I20260807 18:14:20.802762 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.62:33339
--webserver_interface=127.19.201.62
--webserver_port=0
--builtin_ntp_servers=127.19.201.20:36341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.201.62:33339,127.19.201.61:45471
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=4
--master_auto_join_cluster=false with env {}
W20260807 18:14:21.166088 23921 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:14:21.166395 23921 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:14:21.166483 23921 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:14:21.173966 23921 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:14:21.174088 23921 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:14:21.174130 23921 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:14:21.174180 23921 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:14:21.183676 23921 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:36341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=4
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.201.62:33339,127.19.201.61:45471
--master_auto_join_cluster=false
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.62:33339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.201.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
W20260807 18:14:21.184044 23921 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.19.201.62:33339,127.19.201.61:45471'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 18:14:21.185320 23921 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:14:21.187254 23921 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:14:21.200469 23933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:21.200491 23930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:21.200552 23928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:14:21.201242 23921 server_base.cc:1034] running on GCE node
I20260807 18:14:21.202215 23921 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:14:21.203686 23921 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:14:21.204970 23921 hybrid_clock.cc:648] HybridClock initialized: now 1786126461204894 us; error 44 us; skew 500 ppm
I20260807 18:14:21.205523 23921 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:14:21.208071 23921 webserver.cc:460] Webserver started at http://127.19.201.62:44785/ using document root <none> and password file <none>
I20260807 18:14:21.208880 23921 fs_manager.cc:359] Metadata directory not provided
I20260807 18:14:21.209034 23921 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:14:21.209460 23921 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:14:21.212249 23921 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/data/instance:
uuid: "d72da1fc2c8c4797915d9341daa0a68a"
format_stamp: "Formatted at 2026-08-07 18:14:21 on dist-test-slave-bw88"
I20260807 18:14:21.213073 23921 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/wal/instance:
uuid: "d72da1fc2c8c4797915d9341daa0a68a"
format_stamp: "Formatted at 2026-08-07 18:14:21 on dist-test-slave-bw88"
I20260807 18:14:21.218505 23921 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 18:14:21.222071 23939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:14:21.223502 23921 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:14:21.223795 23921 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/wal
uuid: "d72da1fc2c8c4797915d9341daa0a68a"
format_stamp: "Formatted at 2026-08-07 18:14:21 on dist-test-slave-bw88"
I20260807 18:14:21.224049 23921 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:14:21.247803 23921 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:14:21.248785 23921 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:14:21.249172 23921 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:14:21.269052 23921 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.62:33339
I20260807 18:14:21.269063 24005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.62:33339 every 8 connection(s)
I20260807 18:14:21.270670 23921 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
I20260807 18:14:21.274760 24006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:21.276845 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 23921
I20260807 18:14:21.277091 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/wal/instance
I20260807 18:14:21.278471 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.61:45471
--webserver_interface=127.19.201.61
--webserver_port=0
--builtin_ntp_servers=127.19.201.20:36341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.201.62:33339,127.19.201.61:45471
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=4
--master_auto_join_cluster=false with env {}
I20260807 18:14:21.281550 24006 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33339 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:14:21.305742 24006 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.61" port: 45471 } has no permanent_uuid. Determining permanent_uuid...
W20260807 18:14:21.307143 23940 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.201.61:45471: connect: Connection refused (error 111)
W20260807 18:14:21.308871 24006 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:45471: Network error: Client connection negotiation failed: client connection to 127.19.201.61:45471: connect: Connection refused (error 111)
I20260807 18:14:21.358305 24006 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 45471 } attempt: 1
W20260807 18:14:21.360798 24006 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:45471: Network error: Client connection negotiation failed: client connection to 127.19.201.61:45471: connect: Connection refused (error 111)
I20260807 18:14:21.429095 24006 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 45471 } attempt: 2
W20260807 18:14:21.431520 24006 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:45471: Network error: Client connection negotiation failed: client connection to 127.19.201.61:45471: connect: Connection refused (error 111)
I20260807 18:14:21.522835 24006 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 45471 } attempt: 3
W20260807 18:14:21.525167 24006 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:45471: Network error: Client connection negotiation failed: client connection to 127.19.201.61:45471: connect: Connection refused (error 111)
W20260807 18:14:21.665105 24008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:14:21.665629 24008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:14:21.665849 24008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 18:14:21.668478 24006 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 45471 } attempt: 4
W20260807 18:14:21.671079 24006 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:45471: Network error: Client connection negotiation failed: client connection to 127.19.201.61:45471: connect: Connection refused (error 111)
W20260807 18:14:21.676167 24008 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:14:21.676407 24008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:14:21.676522 24008 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:14:21.676666 24008 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:14:21.688835 24008 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:36341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=4
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.201.62:33339,127.19.201.61:45471
--master_auto_join_cluster=false
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.61:45471
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.201.61
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
W20260807 18:14:21.689438 24008 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.19.201.62:33339,127.19.201.61:45471'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 18:14:21.690795 24008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:14:21.693025 24008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:14:21.711266 24018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:21.711143 24019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:21.712211 24021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:14:21.713187 24008 server_base.cc:1034] running on GCE node
I20260807 18:14:21.714277 24008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:14:21.716078 24008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:14:21.717399 24008 hybrid_clock.cc:648] HybridClock initialized: now 1786126461717285 us; error 82 us; skew 500 ppm
I20260807 18:14:21.717923 24008 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:14:21.721712 24008 webserver.cc:460] Webserver started at http://127.19.201.61:36885/ using document root <none> and password file <none>
I20260807 18:14:21.722818 24008 fs_manager.cc:359] Metadata directory not provided
I20260807 18:14:21.723039 24008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:14:21.723527 24008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:14:21.727049 24008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-1/data/instance:
uuid: "dca3c31c553f4c848bf882cfa7d3a5f1"
format_stamp: "Formatted at 2026-08-07 18:14:21 on dist-test-slave-bw88"
I20260807 18:14:21.728143 24008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-1/wal/instance:
uuid: "dca3c31c553f4c848bf882cfa7d3a5f1"
format_stamp: "Formatted at 2026-08-07 18:14:21 on dist-test-slave-bw88"
I20260807 18:14:21.735531 24008 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.004s
I20260807 18:14:21.740468 24030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:14:21.742017 24008 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 18:14:21.742257 24008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-1/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-1/wal
uuid: "dca3c31c553f4c848bf882cfa7d3a5f1"
format_stamp: "Formatted at 2026-08-07 18:14:21 on dist-test-slave-bw88"
I20260807 18:14:21.742528 24008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:14:21.771313 24008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:14:21.772760 24008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:14:21.773285 24008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:14:21.814695 24008 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.61:45471
I20260807 18:14:21.814713 24112 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.61:45471 every 8 connection(s)
I20260807 18:14:21.816273 24008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb
I20260807 18:14:21.820448 24114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:21.826565 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 24008
I20260807 18:14:21.826790 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-1/wal/instance
I20260807 18:14:21.827211 24114 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33339 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:14:21.852864 24114 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.61" port: 45471 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:14:21.863668 24114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dca3c31c553f4c848bf882cfa7d3a5f1: Bootstrap starting.
I20260807 18:14:21.867185 24114 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dca3c31c553f4c848bf882cfa7d3a5f1: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:21.868323 24114 log.cc:824] T 00000000000000000000000000000000 P dca3c31c553f4c848bf882cfa7d3a5f1: Log is configured to *not* fsync() on all Append() calls
I20260807 18:14:21.871544 24114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dca3c31c553f4c848bf882cfa7d3a5f1: No bootstrap required, opened a new log
I20260807 18:14:21.879662 24114 raft_consensus.cc:348] T 00000000000000000000000000000000 P dca3c31c553f4c848bf882cfa7d3a5f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72da1fc2c8c4797915d9341daa0a68a" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33339 } } peers { permanent_uuid: "dca3c31c553f4c848bf882cfa7d3a5f1" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 45471 } }
I20260807 18:14:21.880028 24114 raft_consensus.cc:374] T 00000000000000000000000000000000 P dca3c31c553f4c848bf882cfa7d3a5f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:21.880110 24114 raft_consensus.cc:729] T 00000000000000000000000000000000 P dca3c31c553f4c848bf882cfa7d3a5f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dca3c31c553f4c848bf882cfa7d3a5f1, State: Initialized, Role: FOLLOWER
I20260807 18:14:21.880709 24114 consensus_queue.cc:260] T 00000000000000000000000000000000 P dca3c31c553f4c848bf882cfa7d3a5f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72da1fc2c8c4797915d9341daa0a68a" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33339 } } peers { permanent_uuid: "dca3c31c553f4c848bf882cfa7d3a5f1" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 45471 } }
I20260807 18:14:21.881721 24123 sys_catalog.cc:455] T 00000000000000000000000000000000 P dca3c31c553f4c848bf882cfa7d3a5f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72da1fc2c8c4797915d9341daa0a68a" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33339 } } peers { permanent_uuid: "dca3c31c553f4c848bf882cfa7d3a5f1" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 45471 } } }
I20260807 18:14:21.882078 24123 sys_catalog.cc:458] T 00000000000000000000000000000000 P dca3c31c553f4c848bf882cfa7d3a5f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:21.882921 24114 sys_catalog.cc:564] T 00000000000000000000000000000000 P dca3c31c553f4c848bf882cfa7d3a5f1 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 18:14:21.892686 24138 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dca3c31c553f4c848bf882cfa7d3a5f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:14:21.892844 24138 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:14:21.970386 24006 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 45471 } attempt: 5
I20260807 18:14:21.984827 24006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a: Bootstrap starting.
I20260807 18:14:21.989038 24006 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:21.990424 24006 log.cc:824] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a: Log is configured to *not* fsync() on all Append() calls
I20260807 18:14:21.993286 24006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a: No bootstrap required, opened a new log
I20260807 18:14:22.001066 24006 raft_consensus.cc:348] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72da1fc2c8c4797915d9341daa0a68a" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33339 } } peers { permanent_uuid: "dca3c31c553f4c848bf882cfa7d3a5f1" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 45471 } }
I20260807 18:14:22.001560 24006 raft_consensus.cc:374] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:22.001693 24006 raft_consensus.cc:729] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d72da1fc2c8c4797915d9341daa0a68a, State: Initialized, Role: FOLLOWER
I20260807 18:14:22.002507 24006 consensus_queue.cc:260] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72da1fc2c8c4797915d9341daa0a68a" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33339 } } peers { permanent_uuid: "dca3c31c553f4c848bf882cfa7d3a5f1" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 45471 } }
I20260807 18:14:22.003556 24144 sys_catalog.cc:455] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72da1fc2c8c4797915d9341daa0a68a" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33339 } } peers { permanent_uuid: "dca3c31c553f4c848bf882cfa7d3a5f1" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 45471 } } }
I20260807 18:14:22.003959 24144 sys_catalog.cc:458] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:22.005128 24006 sys_catalog.cc:564] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [sys.catalog]: configured and running, proceeding with master startup.
W20260807 18:14:22.014849 24158 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:14:22.015026 24158 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260807 18:14:22.026302 24042 tablet.cc:2369] T 00000000000000000000000000000000 P dca3c31c553f4c848bf882cfa7d3a5f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:14:22.116295 24144 raft_consensus.cc:482] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:14:22.116665 24144 raft_consensus.cc:504] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72da1fc2c8c4797915d9341daa0a68a" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33339 } } peers { permanent_uuid: "dca3c31c553f4c848bf882cfa7d3a5f1" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 45471 } }
I20260807 18:14:22.118444 24144 leader_election.cc:288] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dca3c31c553f4c848bf882cfa7d3a5f1 (127.19.201.61:45471)
I20260807 18:14:22.119494 24073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d72da1fc2c8c4797915d9341daa0a68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dca3c31c553f4c848bf882cfa7d3a5f1" is_pre_election: true
I20260807 18:14:22.120213 24073 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dca3c31c553f4c848bf882cfa7d3a5f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d72da1fc2c8c4797915d9341daa0a68a in term 0.
I20260807 18:14:22.121507 23940 leader_election.cc:302] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: d72da1fc2c8c4797915d9341daa0a68a, dca3c31c553f4c848bf882cfa7d3a5f1; no voters:
I20260807 18:14:22.122834 24144 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:14:22.123181 24144 raft_consensus.cc:482] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:14:22.123441 24144 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:22.127280 24144 raft_consensus.cc:504] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72da1fc2c8c4797915d9341daa0a68a" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33339 } } peers { permanent_uuid: "dca3c31c553f4c848bf882cfa7d3a5f1" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 45471 } }
I20260807 18:14:22.128007 24144 leader_election.cc:288] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [CANDIDATE]: Term 1 election: Requested vote from peers dca3c31c553f4c848bf882cfa7d3a5f1 (127.19.201.61:45471)
I20260807 18:14:22.128707 24073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d72da1fc2c8c4797915d9341daa0a68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dca3c31c553f4c848bf882cfa7d3a5f1"
I20260807 18:14:22.128981 24073 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dca3c31c553f4c848bf882cfa7d3a5f1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:22.132452 24073 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dca3c31c553f4c848bf882cfa7d3a5f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d72da1fc2c8c4797915d9341daa0a68a in term 1.
I20260807 18:14:22.133097 23940 leader_election.cc:302] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: d72da1fc2c8c4797915d9341daa0a68a, dca3c31c553f4c848bf882cfa7d3a5f1; no voters:
I20260807 18:14:22.133548 24144 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:22.134161 24144 raft_consensus.cc:686] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [term 1 LEADER]: Becoming Leader. State: Replica: d72da1fc2c8c4797915d9341daa0a68a, State: Running, Role: LEADER
I20260807 18:14:22.134855 24144 consensus_queue.cc:237] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72da1fc2c8c4797915d9341daa0a68a" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33339 } } peers { permanent_uuid: "dca3c31c553f4c848bf882cfa7d3a5f1" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 45471 } }
I20260807 18:14:22.149945 24160 sys_catalog.cc:455] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [sys.catalog]: SysCatalogTable state changed. Reason: New leader d72da1fc2c8c4797915d9341daa0a68a. Latest consensus state: current_term: 1 leader_uuid: "d72da1fc2c8c4797915d9341daa0a68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72da1fc2c8c4797915d9341daa0a68a" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33339 } } peers { permanent_uuid: "dca3c31c553f4c848bf882cfa7d3a5f1" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 45471 } } }
I20260807 18:14:22.150484 24160 sys_catalog.cc:458] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [sys.catalog]: This master's current role is: LEADER
I20260807 18:14:22.152861 24163 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:14:22.155323 24163 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:14:22.165889 24073 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dca3c31c553f4c848bf882cfa7d3a5f1 [term 1 FOLLOWER]: Refusing update from remote peer d72da1fc2c8c4797915d9341daa0a68a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:14:22.167169 24160 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dca3c31c553f4c848bf882cfa7d3a5f1" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 45471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:14:22.183295 24123 sys_catalog.cc:455] T 00000000000000000000000000000000 P dca3c31c553f4c848bf882cfa7d3a5f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d72da1fc2c8c4797915d9341daa0a68a. Latest consensus state: current_term: 1 leader_uuid: "d72da1fc2c8c4797915d9341daa0a68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72da1fc2c8c4797915d9341daa0a68a" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33339 } } peers { permanent_uuid: "dca3c31c553f4c848bf882cfa7d3a5f1" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 45471 } } }
I20260807 18:14:22.183609 24123 sys_catalog.cc:458] T 00000000000000000000000000000000 P dca3c31c553f4c848bf882cfa7d3a5f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:22.189016 24164 mvcc.cc:205] Tried to move back new op lower bound from 7315973989018525696 to 7315973988909219840. Current Snapshot: MvccSnapshot[applied={T|T < 7315973989018525696}]
I20260807 18:14:22.190676 24144 sys_catalog.cc:455] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d72da1fc2c8c4797915d9341daa0a68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72da1fc2c8c4797915d9341daa0a68a" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33339 } } peers { permanent_uuid: "dca3c31c553f4c848bf882cfa7d3a5f1" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 45471 } } }
I20260807 18:14:22.191663 24144 sys_catalog.cc:458] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [sys.catalog]: This master's current role is: LEADER
I20260807 18:14:22.191532 24123 sys_catalog.cc:455] T 00000000000000000000000000000000 P dca3c31c553f4c848bf882cfa7d3a5f1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d72da1fc2c8c4797915d9341daa0a68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72da1fc2c8c4797915d9341daa0a68a" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33339 } } peers { permanent_uuid: "dca3c31c553f4c848bf882cfa7d3a5f1" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 45471 } } }
I20260807 18:14:22.191829 24123 sys_catalog.cc:458] T 00000000000000000000000000000000 P dca3c31c553f4c848bf882cfa7d3a5f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:22.194245 24163 catalog_manager.cc:1347] Generated new cluster ID: 5e308f25e3b146aab31aee6629752690
I20260807 18:14:22.194350 24163 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:14:22.209779 24163 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:14:22.211860 24163 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:14:22.224587 24163 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a: Generated new TSK 0
I20260807 18:14:22.225896 24163 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:14:22.242885 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.201.1:0
--local_ip_for_outbound_sockets=127.19.201.1
--webserver_interface=127.19.201.1
--webserver_port=0
--tserver_master_addrs=127.19.201.62:33339,127.19.201.61:45471
--builtin_ntp_servers=127.19.201.20:36341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20260807 18:14:22.644622 24169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:14:22.644942 24169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:14:22.645077 24169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:14:22.652815 24169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:14:22.653040 24169 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.201.1
I20260807 18:14:22.662919 24169 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:36341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.201.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.201.1
--webserver_port=0
--tserver_master_addrs=127.19.201.62:33339,127.19.201.61:45471
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.201.1
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
I20260807 18:14:22.664430 24169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:14:22.666468 24169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:14:22.680779 24178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:22.680706 24174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:22.680748 24175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:14:22.682220 24169 server_base.cc:1034] running on GCE node
I20260807 18:14:22.683018 24169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:14:22.684139 24169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:14:22.685464 24169 hybrid_clock.cc:648] HybridClock initialized: now 1786126462685355 us; error 49 us; skew 500 ppm
I20260807 18:14:22.685920 24169 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:14:22.688795 24169 webserver.cc:460] Webserver started at http://127.19.201.1:38519/ using document root <none> and password file <none>
I20260807 18:14:22.689680 24169 fs_manager.cc:359] Metadata directory not provided
I20260807 18:14:22.689816 24169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:14:22.690164 24169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:14:22.693192 24169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/data/instance:
uuid: "b878e428bd0f4cce8de50d7d61ac1ad0"
format_stamp: "Formatted at 2026-08-07 18:14:22 on dist-test-slave-bw88"
I20260807 18:14:22.694093 24169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/wal/instance:
uuid: "b878e428bd0f4cce8de50d7d61ac1ad0"
format_stamp: "Formatted at 2026-08-07 18:14:22 on dist-test-slave-bw88"
I20260807 18:14:22.699925 24169 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260807 18:14:22.703966 24190 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:14:22.705804 24169 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:14:22.705994 24169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/wal
uuid: "b878e428bd0f4cce8de50d7d61ac1ad0"
format_stamp: "Formatted at 2026-08-07 18:14:22 on dist-test-slave-bw88"
I20260807 18:14:22.706271 24169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:14:22.739933 24169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:14:22.740902 24169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:14:22.741189 24169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:14:22.742293 24169 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:14:22.743902 24169 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:14:22.743979 24169 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:14:22.744071 24169 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:14:22.744117 24169 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:14:22.779446 24169 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.1:38723
I20260807 18:14:22.779536 24349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.1:38723 every 8 connection(s)
I20260807 18:14:22.780874 24169 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb
I20260807 18:14:22.788403 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 24169
I20260807 18:14:22.788661 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/wal/instance
I20260807 18:14:22.799660 24353 heartbeater.cc:347] Connected to a master server at 127.19.201.62:33339
I20260807 18:14:22.799636 24350 heartbeater.cc:347] Connected to a master server at 127.19.201.61:45471
I20260807 18:14:22.800077 24350 heartbeater.cc:464] Registering TS with master...
I20260807 18:14:22.800079 24353 heartbeater.cc:464] Registering TS with master...
I20260807 18:14:22.801390 24353 heartbeater.cc:511] Master 127.19.201.62:33339 requested a full tablet report, sending...
I20260807 18:14:22.801414 24350 heartbeater.cc:511] Master 127.19.201.61:45471 requested a full tablet report, sending...
I20260807 18:14:22.804201 23962 ts_manager.cc:194] Registered new tserver with Master: b878e428bd0f4cce8de50d7d61ac1ad0 (127.19.201.1:38723)
I20260807 18:14:22.804214 24057 ts_manager.cc:194] Registered new tserver with Master: b878e428bd0f4cce8de50d7d61ac1ad0 (127.19.201.1:38723)
I20260807 18:14:22.806298 23962 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.201.1:54899
I20260807 18:14:22.810220 20260 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20260807 18:14:22.816489 20260 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20260807 18:14:22.844565 23962 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51190:
name: "first_table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:22.878782 24258 tablet_service.cc:1467] Processing CreateTablet for tablet 4a19faa036234a7ba23afdce4aa49e8a (DEFAULT_TABLE table=first_table [id=e434486f728d4ddb9e90c629cc54defc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:22.880225 24258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a19faa036234a7ba23afdce4aa49e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:22.891708 24378 tablet_bootstrap.cc:492] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0: Bootstrap starting.
I20260807 18:14:22.895358 24378 tablet_bootstrap.cc:654] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:22.895404 24138 catalog_manager.cc:1259] Loaded cluster ID: 5e308f25e3b146aab31aee6629752690
I20260807 18:14:22.895483 24138 catalog_manager.cc:1552] T 00000000000000000000000000000000 P dca3c31c553f4c848bf882cfa7d3a5f1: loading cluster ID for follower catalog manager: success
I20260807 18:14:22.896870 24378 log.cc:824] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0: Log is configured to *not* fsync() on all Append() calls
I20260807 18:14:22.899097 24138 catalog_manager.cc:1574] T 00000000000000000000000000000000 P dca3c31c553f4c848bf882cfa7d3a5f1: acquiring CA information for follower catalog manager: success
I20260807 18:14:22.900154 24378 tablet_bootstrap.cc:492] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0: No bootstrap required, opened a new log
I20260807 18:14:22.900475 24378 ts_tablet_manager.cc:1397] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260807 18:14:22.901661 24138 catalog_manager.cc:1602] T 00000000000000000000000000000000 P dca3c31c553f4c848bf882cfa7d3a5f1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 18:14:22.908092 24378 raft_consensus.cc:348] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b878e428bd0f4cce8de50d7d61ac1ad0" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 38723 } }
I20260807 18:14:22.908428 24378 raft_consensus.cc:374] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:22.908505 24378 raft_consensus.cc:729] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b878e428bd0f4cce8de50d7d61ac1ad0, State: Initialized, Role: FOLLOWER
I20260807 18:14:22.909026 24378 consensus_queue.cc:260] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b878e428bd0f4cce8de50d7d61ac1ad0" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 38723 } }
I20260807 18:14:22.909232 24378 raft_consensus.cc:388] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:22.909329 24378 raft_consensus.cc:482] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:22.909525 24378 raft_consensus.cc:3037] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:22.911665 24378 raft_consensus.cc:504] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b878e428bd0f4cce8de50d7d61ac1ad0" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 38723 } }
I20260807 18:14:22.912181 24378 leader_election.cc:302] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b878e428bd0f4cce8de50d7d61ac1ad0; no voters:
I20260807 18:14:22.912847 24378 leader_election.cc:288] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:22.913038 24380 raft_consensus.cc:2781] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:22.913847 24380 raft_consensus.cc:686] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [term 1 LEADER]: Becoming Leader. State: Replica: b878e428bd0f4cce8de50d7d61ac1ad0, State: Running, Role: LEADER
I20260807 18:14:22.914088 24353 heartbeater.cc:503] Master 127.19.201.62:33339 was elected leader, sending a full tablet report...
I20260807 18:14:22.914523 24380 consensus_queue.cc:237] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b878e428bd0f4cce8de50d7d61ac1ad0" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 38723 } }
I20260807 18:14:22.915390 24378 ts_tablet_manager.cc:1428] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0: Time spent starting tablet: real 0.015s user 0.010s sys 0.005s
I20260807 18:14:22.923008 23962 catalog_manager.cc:5495] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 reported cstate change: term changed from 0 to 1, leader changed from <none> to b878e428bd0f4cce8de50d7d61ac1ad0 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "b878e428bd0f4cce8de50d7d61ac1ad0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b878e428bd0f4cce8de50d7d61ac1ad0" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 38723 } health_report { overall_health: HEALTHY } } }
W20260807 18:14:23.291603 24386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:14:23.291981 24386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:14:23.299826 24386 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
I20260807 18:14:23.337289 23962 catalog_manager.cc:6979] Initiating ChangeConfig request to remove master 127.19.201.61:45471: tablet_id: "00000000000000000000000000000000"
type: REMOVE_PEER
server {
permanent_uuid: "dca3c31c553f4c848bf882cfa7d3a5f1"
}
dest_uuid: "d72da1fc2c8c4797915d9341daa0a68a"
cas_config_opid_index: -1
I20260807 18:14:23.338433 23962 consensus_queue.cc:237] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d72da1fc2c8c4797915d9341daa0a68a" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33339 } }
I20260807 18:14:23.339438 24370 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index -1 to 8, VOTER dca3c31c553f4c848bf882cfa7d3a5f1 (127.19.201.61) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d72da1fc2c8c4797915d9341daa0a68a" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33339 } } }
I20260807 18:14:23.342124 24370 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to remove master 127.19.201.61:45471
I20260807 18:14:23.342557 24144 sys_catalog.cc:455] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "d72da1fc2c8c4797915d9341daa0a68a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d72da1fc2c8c4797915d9341daa0a68a" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33339 } } }
I20260807 18:14:23.342747 24144 sys_catalog.cc:458] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [sys.catalog]: This master's current role is: LEADER
I20260807 18:14:23.342929 24386 tool_action_master.cc:566] Successfully removed master 127.19.201.61:45471 from the cluster. Please follow the next steps from the Kudu administration documentation on "Removing Kudu Masters from a Multi-Master Deployment" or "Recovering from a dead Kudu Master in a Multi-Master Deployment" as appropriate.
W20260807 18:14:23.427073 20260 subprocess.cc:277] Child process 24008 (/tmp/dist-test-taskorkq8y/build/asan/bin/kudu --fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-1/wal --fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-1/data --block_manager=log --webserver_interface=localhost --never_fsync --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-1/logs --server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --logtostderr --logbuflevel=-1 --ipki_server_key_size=768 --openssl_security_level_override=0 master run --ipki_ca_key_size=768 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.19.201.61:45471 --webserver_interface=127.19.201.61 --webserver_port=0 --builtin_ntp_servers=127.19.201.20:36341 --builtin_ntp_poll_interval_ms=100 --ntp_initial_sync_wait_secs=10 --time_source=builtin --rpc_reuseport=true --master_addresses=127.19.201.62:33339,127.19.201.61:45471 --consensus_rpc_timeout_ms=2000 --follower_unavailable_considered_failed_sec=4 --master_auto_join_cluster=false) was orphaned. Sending signal 9...
I20260807 18:14:23.549057 24258 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
d72da1fc2c8c4797915d9341daa0a68a | 127.19.201.62:33339 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.19.201.20:36341 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
b878e428bd0f4cce8de50d7d61ac1ad0 | 127.19.201.1:38723 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 1
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
local_ip_for_outbound_sockets | 127.19.201.1 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb | hidden | all 1 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.19.201.20:36341 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 2 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-------------+----+---------+---------------+---------+------------+------------------+-------------
first_table | 1 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 1
Tables | 1
Tablets | 1
Replicas | 1
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260807 18:14:23.580399 20260 log_verifier.cc:126] Checking tablet 4a19faa036234a7ba23afdce4aa49e8a
I20260807 18:14:23.589561 20260 log_verifier.cc:177] Verified matching terms for 1 ops in tablet 4a19faa036234a7ba23afdce4aa49e8a
W20260807 18:14:23.926510 24350 heartbeater.cc:644] Failed to heartbeat to 127.19.201.61:45471 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.201.61:45471: connect: Connection refused (error 111)
E20260807 18:14:24.032534 23962 master_service.cc:344] Failed removing master 127.19.201.61:45471. Not found: Master 127.19.201.61:45471 not found
I20260807 18:14:24.117554 20260 dynamic_multi_master-test.cc:1021] Transferring leadership to master: dca3c31c553f4c848bf882cfa7d3a5f1
I20260807 18:14:24.121179 23976 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "d72da1fc2c8c4797915d9341daa0a68a"
mode: GRACEFUL
new_leader_uuid: "dca3c31c553f4c848bf882cfa7d3a5f1"
from {username='slave'} at 127.0.0.1:51288
I20260807 18:14:24.121616 23976 raft_consensus.cc:595] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [term 1 LEADER]: Received request to transfer leadership to TS dca3c31c553f4c848bf882cfa7d3a5f1
I20260807 18:14:24.121800 23976 raft_consensus.cc:619] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [term 1 LEADER]: Rejecting request to transfer leadership because tablet server dca3c31c553f4c848bf882cfa7d3a5f1 is not a voter in the active config
I20260807 18:14:24.122781 20260 dynamic_multi_master-test.cc:1028] Shutting down the old cluster
I20260807 18:14:24.122936 20260 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskorkq8y/build/asan/bin/kudu pid 24169
I20260807 18:14:24.130805 24345 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 18:14:24.244046 20260 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskorkq8y/build/asan/bin/kudu with pid 24169
I20260807 18:14:24.275419 20260 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskorkq8y/build/asan/bin/kudu pid 23921
I20260807 18:14:24.276708 24000 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 18:14:24.387740 20260 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskorkq8y/build/asan/bin/kudu with pid 23921
2026-08-07T18:14:24Z chronyd exiting
I20260807 18:14:24.429298 20260 dynamic_multi_master-test.cc:1031] Bringing up the migrated cluster
2026-08-07T18:14:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:14:24Z Disabled control of system clock
I20260807 18:14:24.463702 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.62:33339
--webserver_interface=127.19.201.62
--webserver_port=0
--builtin_ntp_servers=127.19.201.20:42285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.201.62:33339
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=4
--master_auto_join_cluster=false with env {}
W20260807 18:14:24.810102 24468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:14:24.810416 24468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:14:24.810559 24468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:14:24.817873 24468 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:14:24.817993 24468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:14:24.818135 24468 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:14:24.818239 24468 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:14:24.827469 24468 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:42285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=4
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.201.62:33339
--master_auto_join_cluster=false
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.62:33339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.201.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
I20260807 18:14:24.828977 24468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:14:24.830938 24468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:14:24.843084 24474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:24.843163 24475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:24.843576 24477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:14:24.844496 24468 server_base.cc:1034] running on GCE node
I20260807 18:14:24.845297 24468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:14:24.846875 24468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:14:24.848170 24468 hybrid_clock.cc:648] HybridClock initialized: now 1786126464848110 us; error 31 us; skew 500 ppm
I20260807 18:14:24.848598 24468 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:14:24.851116 24468 webserver.cc:460] Webserver started at http://127.19.201.62:41685/ using document root <none> and password file <none>
I20260807 18:14:24.851876 24468 fs_manager.cc:359] Metadata directory not provided
I20260807 18:14:24.852056 24468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:14:24.857709 24468 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 18:14:24.860713 24485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:14:24.862214 24468 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:14:24.862422 24468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/wal
uuid: "d72da1fc2c8c4797915d9341daa0a68a"
format_stamp: "Formatted at 2026-08-07 18:14:21 on dist-test-slave-bw88"
I20260807 18:14:24.863446 24468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:14:24.898751 24468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:14:24.899724 24468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:14:24.900058 24468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:14:24.920220 24468 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.62:33339
I20260807 18:14:24.920238 24548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.62:33339 every 8 connection(s)
I20260807 18:14:24.921948 24468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
I20260807 18:14:24.927378 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 24468
I20260807 18:14:24.927670 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/wal/instance
I20260807 18:14:24.929409 24549 sys_catalog.cc:263] Verifying existing consensus state
I20260807 18:14:24.934556 24549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a: Bootstrap starting.
I20260807 18:14:24.955787 24549 log.cc:824] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a: Log is configured to *not* fsync() on all Append() calls
I20260807 18:14:24.968261 24549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 18:14:24.968791 24549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a: Bootstrap complete.
I20260807 18:14:24.977823 24549 raft_consensus.cc:348] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d72da1fc2c8c4797915d9341daa0a68a" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33339 } }
I20260807 18:14:24.978848 24549 raft_consensus.cc:729] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d72da1fc2c8c4797915d9341daa0a68a, State: Initialized, Role: FOLLOWER
I20260807 18:14:24.979499 24549 consensus_queue.cc:260] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d72da1fc2c8c4797915d9341daa0a68a" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33339 } }
I20260807 18:14:24.979815 24549 raft_consensus.cc:388] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:24.979916 24549 raft_consensus.cc:482] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:24.980062 24549 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:14:24.984440 24549 raft_consensus.cc:504] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d72da1fc2c8c4797915d9341daa0a68a" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33339 } }
I20260807 18:14:24.984907 24549 leader_election.cc:302] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d72da1fc2c8c4797915d9341daa0a68a; no voters:
I20260807 18:14:24.985543 24549 leader_election.cc:288] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 18:14:24.985731 24555 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 18:14:24.986827 24555 raft_consensus.cc:686] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [term 2 LEADER]: Becoming Leader. State: Replica: d72da1fc2c8c4797915d9341daa0a68a, State: Running, Role: LEADER
I20260807 18:14:24.987406 24555 consensus_queue.cc:237] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d72da1fc2c8c4797915d9341daa0a68a" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33339 } }
I20260807 18:14:24.987850 24549 sys_catalog.cc:564] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:14:24.990447 24556 sys_catalog.cc:455] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d72da1fc2c8c4797915d9341daa0a68a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d72da1fc2c8c4797915d9341daa0a68a" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33339 } } }
I20260807 18:14:24.990859 24556 sys_catalog.cc:458] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [sys.catalog]: This master's current role is: LEADER
I20260807 18:14:24.991079 24557 sys_catalog.cc:455] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [sys.catalog]: SysCatalogTable state changed. Reason: New leader d72da1fc2c8c4797915d9341daa0a68a. Latest consensus state: current_term: 2 leader_uuid: "d72da1fc2c8c4797915d9341daa0a68a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d72da1fc2c8c4797915d9341daa0a68a" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 33339 } } }
I20260807 18:14:24.991461 24557 sys_catalog.cc:458] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a [sys.catalog]: This master's current role is: LEADER
I20260807 18:14:24.993235 24570 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:14:25.000315 24570 catalog_manager.cc:669] Loaded metadata for table first_table [id=e434486f728d4ddb9e90c629cc54defc]
I20260807 18:14:25.002993 24570 tablet_loader.cc:96] loaded metadata for tablet 4a19faa036234a7ba23afdce4aa49e8a (table first_table [id=e434486f728d4ddb9e90c629cc54defc])
I20260807 18:14:25.003389 24570 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:14:25.005102 24570 catalog_manager.cc:1259] Loaded cluster ID: 5e308f25e3b146aab31aee6629752690
I20260807 18:14:25.005196 24570 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:14:25.008503 24570 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:14:25.009913 24570 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d72da1fc2c8c4797915d9341daa0a68a: Loaded TSK: 0
I20260807 18:14:25.011370 24570 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:14:25.022905 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.201.1:0
--local_ip_for_outbound_sockets=127.19.201.1
--webserver_interface=127.19.201.1
--webserver_port=0
--tserver_master_addrs=127.19.201.62:33339
--builtin_ntp_servers=127.19.201.20:42285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20260807 18:14:25.388127 24585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:14:25.388476 24585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:14:25.388643 24585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:14:25.396188 24585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:14:25.396402 24585 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.201.1
I20260807 18:14:25.405726 24585 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:42285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.201.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.201.1
--webserver_port=0
--tserver_master_addrs=127.19.201.62:33339
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.201.1
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
I20260807 18:14:25.407191 24585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:14:25.409101 24585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:14:25.423027 24591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:25.422979 24596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:25.423067 24593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:14:25.424232 24585 server_base.cc:1034] running on GCE node
I20260807 18:14:25.424923 24585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:14:25.425997 24585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:14:25.427280 24585 hybrid_clock.cc:648] HybridClock initialized: now 1786126465427224 us; error 33 us; skew 500 ppm
I20260807 18:14:25.427635 24585 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:14:25.430208 24585 webserver.cc:460] Webserver started at http://127.19.201.1:38473/ using document root <none> and password file <none>
I20260807 18:14:25.430987 24585 fs_manager.cc:359] Metadata directory not provided
I20260807 18:14:25.431161 24585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:14:25.436777 24585 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 18:14:25.440095 24602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:14:25.441618 24585 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 18:14:25.441799 24585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/wal
uuid: "b878e428bd0f4cce8de50d7d61ac1ad0"
format_stamp: "Formatted at 2026-08-07 18:14:22 on dist-test-slave-bw88"
I20260807 18:14:25.442860 24585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:14:25.461802 24585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:14:25.462628 24585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:14:25.462873 24585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:14:25.463868 24585 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:14:25.465977 24612 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260807 18:14:25.471809 24585 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 18:14:25.471928 24585 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260807 18:14:25.472124 24585 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 18:14:25.475461 24585 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 18:14:25.475551 24585 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.001s sys 0.001s
I20260807 18:14:25.475986 24612 tablet_bootstrap.cc:492] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0: Bootstrap starting.
I20260807 18:14:25.494666 24612 log.cc:824] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0: Log is configured to *not* fsync() on all Append() calls
I20260807 18:14:25.499432 24612 tablet_bootstrap.cc:492] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 18:14:25.500257 24612 tablet_bootstrap.cc:492] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0: Bootstrap complete.
I20260807 18:14:25.502107 24612 ts_tablet_manager.cc:1397] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0: Time spent bootstrapping tablet: real 0.026s user 0.017s sys 0.008s
I20260807 18:14:25.515221 24612 raft_consensus.cc:348] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b878e428bd0f4cce8de50d7d61ac1ad0" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 38723 } }
I20260807 18:14:25.516955 24612 raft_consensus.cc:729] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b878e428bd0f4cce8de50d7d61ac1ad0, State: Initialized, Role: FOLLOWER
I20260807 18:14:25.518151 24612 consensus_queue.cc:260] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b878e428bd0f4cce8de50d7d61ac1ad0" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 38723 } }
I20260807 18:14:25.518507 24612 raft_consensus.cc:388] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:25.518702 24612 raft_consensus.cc:482] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:25.518894 24612 raft_consensus.cc:3037] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:14:25.524382 24612 raft_consensus.cc:504] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b878e428bd0f4cce8de50d7d61ac1ad0" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 38723 } }
I20260807 18:14:25.525130 24612 leader_election.cc:302] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b878e428bd0f4cce8de50d7d61ac1ad0; no voters:
I20260807 18:14:25.525928 24612 leader_election.cc:288] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 18:14:25.526063 24752 raft_consensus.cc:2781] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 18:14:25.526989 24752 raft_consensus.cc:686] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [term 2 LEADER]: Becoming Leader. State: Replica: b878e428bd0f4cce8de50d7d61ac1ad0, State: Running, Role: LEADER
I20260807 18:14:25.527815 24752 consensus_queue.cc:237] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b878e428bd0f4cce8de50d7d61ac1ad0" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 38723 } }
I20260807 18:14:25.530763 24612 ts_tablet_manager.cc:1428] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0: Time spent starting tablet: real 0.029s user 0.020s sys 0.008s
I20260807 18:14:25.534247 24585 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.1:42043
I20260807 18:14:25.534247 24762 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.1:42043 every 8 connection(s)
I20260807 18:14:25.535751 24585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb
I20260807 18:14:25.539062 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 24585
I20260807 18:14:25.539291 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/wal/instance
I20260807 18:14:25.550180 24764 heartbeater.cc:347] Connected to a master server at 127.19.201.62:33339
I20260807 18:14:25.550489 24764 heartbeater.cc:464] Registering TS with master...
I20260807 18:14:25.551244 24764 heartbeater.cc:511] Master 127.19.201.62:33339 requested a full tablet report, sending...
I20260807 18:14:25.554721 24503 ts_manager.cc:194] Registered new tserver with Master: b878e428bd0f4cce8de50d7d61ac1ad0 (127.19.201.1:42043)
I20260807 18:14:25.556396 20260 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20260807 18:14:25.556173 24503 catalog_manager.cc:5495] T 4a19faa036234a7ba23afdce4aa49e8a P b878e428bd0f4cce8de50d7d61ac1ad0 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "b878e428bd0f4cce8de50d7d61ac1ad0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b878e428bd0f4cce8de50d7d61ac1ad0" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 38723 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:25.570567 24503 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.201.1:60109
I20260807 18:14:25.573894 24764 heartbeater.cc:503] Master 127.19.201.62:33339 was elected leader, sending a full tablet report...
I20260807 18:14:25.653106 24672 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
d72da1fc2c8c4797915d9341daa0a68a | 127.19.201.62:33339 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.19.201.20:42285 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
b878e428bd0f4cce8de50d7d61ac1ad0 | 127.19.201.1:42043 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 1
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
local_ip_for_outbound_sockets | 127.19.201.1 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRemoveMasterTest.TestRemoveMaster_0.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb | hidden | all 1 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.19.201.20:42285 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 2 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-------------+----+---------+---------------+---------+------------+------------------+-------------
first_table | 1 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 1
Tables | 1
Tablets | 1
Replicas | 1
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260807 18:14:25.688642 20260 log_verifier.cc:126] Checking tablet 4a19faa036234a7ba23afdce4aa49e8a
I20260807 18:14:25.698572 20260 log_verifier.cc:177] Verified matching terms for 2 ops in tablet 4a19faa036234a7ba23afdce4aa49e8a
I20260807 18:14:25.729285 20260 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskorkq8y/build/asan/bin/kudu pid 24585
I20260807 18:14:25.736934 24751 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 18:14:25.830647 20260 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskorkq8y/build/asan/bin/kudu with pid 24585
I20260807 18:14:25.858065 20260 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskorkq8y/build/asan/bin/kudu pid 24468
I20260807 18:14:25.859263 24543 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 18:14:25.966876 20260 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskorkq8y/build/asan/bin/kudu with pid 24468
2026-08-07T18:14:25Z chronyd exiting
[ OK ] ParameterizedRemoveMasterTest.TestRemoveMaster/0 (5245 ms)
[----------] 1 test from ParameterizedRemoveMasterTest (5246 ms total)
[----------] 1 test from ParameterizedRecoverMasterTest
[ RUN ] ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy/0
2026-08-07T18:14:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:14:26Z Disabled control of system clock
I20260807 18:14:26.048350 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.62:38815
--webserver_interface=127.19.201.62
--webserver_port=0
--builtin_ntp_servers=127.19.201.20:44981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.201.62:38815,127.19.201.61:44749
--flush_threshold_secs=0
--log_segment_size_mb=1
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=4
--master_auto_join_cluster=false with env {}
W20260807 18:14:26.398557 24815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:14:26.398903 24815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:14:26.399158 24815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:14:26.410562 24815 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:14:26.410706 24815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:14:26.410785 24815 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:14:26.410867 24815 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 18:14:26.410970 24815 flags.cc:425] Enabled experimental flag: --flush_threshold_secs=0
I20260807 18:14:26.424746 24815 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:44981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=4
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.201.62:38815,127.19.201.61:44749
--master_auto_join_cluster=false
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.62:38815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.201.62
--webserver_port=0
--flush_threshold_secs=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
W20260807 18:14:26.425218 24815 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.19.201.62:38815,127.19.201.61:44749'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 18:14:26.428058 24815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:14:26.430765 24815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:14:26.449179 24821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:26.449227 24824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:26.449422 24829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:14:26.450253 24815 server_base.cc:1034] running on GCE node
I20260807 18:14:26.451321 24815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:14:26.452836 24815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:14:26.454129 24815 hybrid_clock.cc:648] HybridClock initialized: now 1786126466454043 us; error 56 us; skew 500 ppm
I20260807 18:14:26.454571 24815 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:14:26.457504 24815 webserver.cc:460] Webserver started at http://127.19.201.62:34885/ using document root <none> and password file <none>
I20260807 18:14:26.458285 24815 fs_manager.cc:359] Metadata directory not provided
I20260807 18:14:26.458447 24815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:14:26.458837 24815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:14:26.462745 24815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-0/data/instance:
uuid: "57c0c70cc04f4c73ae2bc598047c15e5"
format_stamp: "Formatted at 2026-08-07 18:14:26 on dist-test-slave-bw88"
I20260807 18:14:26.463814 24815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-0/wal/instance:
uuid: "57c0c70cc04f4c73ae2bc598047c15e5"
format_stamp: "Formatted at 2026-08-07 18:14:26 on dist-test-slave-bw88"
I20260807 18:14:26.472350 24815 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.006s sys 0.003s
I20260807 18:14:26.476657 24837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:14:26.478571 24815 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 18:14:26.478785 24815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-0/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-0/wal
uuid: "57c0c70cc04f4c73ae2bc598047c15e5"
format_stamp: "Formatted at 2026-08-07 18:14:26 on dist-test-slave-bw88"
I20260807 18:14:26.479086 24815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:14:26.505939 24815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:14:26.507180 24815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:14:26.507622 24815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:14:26.529362 24815 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.62:38815
I20260807 18:14:26.529403 24902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.62:38815 every 8 connection(s)
I20260807 18:14:26.531131 24815 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
I20260807 18:14:26.534260 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 24815
I20260807 18:14:26.534466 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-0/wal/instance
I20260807 18:14:26.535688 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.61:44749
--webserver_interface=127.19.201.61
--webserver_port=0
--builtin_ntp_servers=127.19.201.20:44981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.201.62:38815,127.19.201.61:44749
--flush_threshold_secs=0
--log_segment_size_mb=1
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=4
--master_auto_join_cluster=false with env {}
I20260807 18:14:26.536070 24904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:26.542474 24904 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.62" port: 38815 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:14:26.563687 24904 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.61" port: 44749 } has no permanent_uuid. Determining permanent_uuid...
W20260807 18:14:26.564858 24839 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.201.61:44749: connect: Connection refused (error 111)
W20260807 18:14:26.566603 24904 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:44749: Network error: Client connection negotiation failed: client connection to 127.19.201.61:44749: connect: Connection refused (error 111)
I20260807 18:14:26.616030 24904 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 44749 } attempt: 1
W20260807 18:14:26.618250 24904 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:44749: Network error: Client connection negotiation failed: client connection to 127.19.201.61:44749: connect: Connection refused (error 111)
I20260807 18:14:26.686560 24904 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 44749 } attempt: 2
W20260807 18:14:26.689074 24904 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:44749: Network error: Client connection negotiation failed: client connection to 127.19.201.61:44749: connect: Connection refused (error 111)
I20260807 18:14:26.780390 24904 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 44749 } attempt: 3
W20260807 18:14:26.782801 24904 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:44749: Network error: Client connection negotiation failed: client connection to 127.19.201.61:44749: connect: Connection refused (error 111)
W20260807 18:14:26.893383 24906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:14:26.893755 24906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:14:26.893915 24906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:14:26.901284 24906 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:14:26.901464 24906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:14:26.901569 24906 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:14:26.901688 24906 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 18:14:26.901808 24906 flags.cc:425] Enabled experimental flag: --flush_threshold_secs=0
I20260807 18:14:26.911569 24906 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:44981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=4
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.201.62:38815,127.19.201.61:44749
--master_auto_join_cluster=false
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.61:44749
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.201.61
--webserver_port=0
--flush_threshold_secs=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
W20260807 18:14:26.911983 24906 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.19.201.62:38815,127.19.201.61:44749'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 18:14:26.913153 24906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:14:26.915076 24906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 18:14:26.926096 24904 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 44749 } attempt: 4
W20260807 18:14:26.927383 24922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:26.928145 24921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:26.928171 24925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:26.928469 24904 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:44749: Network error: Client connection negotiation failed: client connection to 127.19.201.61:44749: connect: Connection refused (error 111)
I20260807 18:14:26.928990 24906 server_base.cc:1034] running on GCE node
I20260807 18:14:26.929919 24906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:14:26.931388 24906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:14:26.932677 24906 hybrid_clock.cc:648] HybridClock initialized: now 1786126466932601 us; error 49 us; skew 500 ppm
I20260807 18:14:26.933058 24906 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:14:26.935526 24906 webserver.cc:460] Webserver started at http://127.19.201.61:34107/ using document root <none> and password file <none>
I20260807 18:14:26.936283 24906 fs_manager.cc:359] Metadata directory not provided
I20260807 18:14:26.936440 24906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:14:26.936774 24906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:14:26.939606 24906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-1/data/instance:
uuid: "8f33b01addea43bbb634aaebb43d272e"
format_stamp: "Formatted at 2026-08-07 18:14:26 on dist-test-slave-bw88"
I20260807 18:14:26.940407 24906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-1/wal/instance:
uuid: "8f33b01addea43bbb634aaebb43d272e"
format_stamp: "Formatted at 2026-08-07 18:14:26 on dist-test-slave-bw88"
I20260807 18:14:26.945982 24906 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 18:14:26.949527 24931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:14:26.950860 24906 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:14:26.951048 24906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-1/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-1/wal
uuid: "8f33b01addea43bbb634aaebb43d272e"
format_stamp: "Formatted at 2026-08-07 18:14:26 on dist-test-slave-bw88"
I20260807 18:14:26.951267 24906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:14:26.967536 24906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:14:26.968387 24906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:14:26.968729 24906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:14:26.988343 24906 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.61:44749
I20260807 18:14:26.988379 25004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.61:44749 every 8 connection(s)
I20260807 18:14:26.990298 24906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb
I20260807 18:14:26.992771 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 24906
I20260807 18:14:26.992993 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/master-1/wal/instance
I20260807 18:14:26.995141 25005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:27.004081 25005 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.62" port: 38815 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:14:27.015843 25005 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.61" port: 44749 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:14:27.026844 25005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e: Bootstrap starting.
I20260807 18:14:27.030351 25005 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:27.031391 25005 log.cc:824] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e: Log is configured to *not* fsync() on all Append() calls
I20260807 18:14:27.034015 25005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e: No bootstrap required, opened a new log
I20260807 18:14:27.041477 25005 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c0c70cc04f4c73ae2bc598047c15e5" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 38815 } } peers { permanent_uuid: "8f33b01addea43bbb634aaebb43d272e" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 44749 } }
I20260807 18:14:27.041807 25005 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:27.041882 25005 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f33b01addea43bbb634aaebb43d272e, State: Initialized, Role: FOLLOWER
I20260807 18:14:27.042517 25005 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c0c70cc04f4c73ae2bc598047c15e5" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 38815 } } peers { permanent_uuid: "8f33b01addea43bbb634aaebb43d272e" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 44749 } }
I20260807 18:14:27.043300 25014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c0c70cc04f4c73ae2bc598047c15e5" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 38815 } } peers { permanent_uuid: "8f33b01addea43bbb634aaebb43d272e" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 44749 } } }
I20260807 18:14:27.043653 25014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:27.044368 25005 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [sys.catalog]: configured and running, proceeding with master startup.
W20260807 18:14:27.053421 25029 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:14:27.053573 25029 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260807 18:14:27.220996 24939 tablet.cc:2369] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:14:27.227730 24904 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 44749 } attempt: 5
I20260807 18:14:27.240244 24904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57c0c70cc04f4c73ae2bc598047c15e5: Bootstrap starting.
I20260807 18:14:27.244684 24904 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57c0c70cc04f4c73ae2bc598047c15e5: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:27.246117 24904 log.cc:824] T 00000000000000000000000000000000 P 57c0c70cc04f4c73ae2bc598047c15e5: Log is configured to *not* fsync() on all Append() calls
I20260807 18:14:27.249529 24904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57c0c70cc04f4c73ae2bc598047c15e5: No bootstrap required, opened a new log
I20260807 18:14:27.260666 24904 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57c0c70cc04f4c73ae2bc598047c15e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c0c70cc04f4c73ae2bc598047c15e5" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 38815 } } peers { permanent_uuid: "8f33b01addea43bbb634aaebb43d272e" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 44749 } }
I20260807 18:14:27.261066 24904 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57c0c70cc04f4c73ae2bc598047c15e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:27.261176 24904 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57c0c70cc04f4c73ae2bc598047c15e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57c0c70cc04f4c73ae2bc598047c15e5, State: Initialized, Role: FOLLOWER
I20260807 18:14:27.261857 24904 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57c0c70cc04f4c73ae2bc598047c15e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c0c70cc04f4c73ae2bc598047c15e5" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 38815 } } peers { permanent_uuid: "8f33b01addea43bbb634aaebb43d272e" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 44749 } }
I20260807 18:14:27.262884 25034 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57c0c70cc04f4c73ae2bc598047c15e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c0c70cc04f4c73ae2bc598047c15e5" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 38815 } } peers { permanent_uuid: "8f33b01addea43bbb634aaebb43d272e" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 44749 } } }
I20260807 18:14:27.263362 25034 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57c0c70cc04f4c73ae2bc598047c15e5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:27.264046 24904 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57c0c70cc04f4c73ae2bc598047c15e5 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 18:14:27.273001 25050 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 57c0c70cc04f4c73ae2bc598047c15e5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:14:27.273152 25050 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:14:27.297513 25014 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:14:27.297852 25014 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c0c70cc04f4c73ae2bc598047c15e5" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 38815 } } peers { permanent_uuid: "8f33b01addea43bbb634aaebb43d272e" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 44749 } }
I20260807 18:14:27.299243 25014 leader_election.cc:288] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57c0c70cc04f4c73ae2bc598047c15e5 (127.19.201.62:38815)
I20260807 18:14:27.300140 24870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8f33b01addea43bbb634aaebb43d272e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57c0c70cc04f4c73ae2bc598047c15e5" is_pre_election: true
I20260807 18:14:27.300724 24870 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 57c0c70cc04f4c73ae2bc598047c15e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f33b01addea43bbb634aaebb43d272e in term 0.
I20260807 18:14:27.301481 24934 leader_election.cc:302] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 57c0c70cc04f4c73ae2bc598047c15e5, 8f33b01addea43bbb634aaebb43d272e; no voters:
I20260807 18:14:27.301941 25014 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:14:27.302117 25014 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:14:27.302211 25014 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:27.304481 25014 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c0c70cc04f4c73ae2bc598047c15e5" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 38815 } } peers { permanent_uuid: "8f33b01addea43bbb634aaebb43d272e" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 44749 } }
I20260807 18:14:27.304961 25014 leader_election.cc:288] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [CANDIDATE]: Term 1 election: Requested vote from peers 57c0c70cc04f4c73ae2bc598047c15e5 (127.19.201.62:38815)
I20260807 18:14:27.305552 24870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8f33b01addea43bbb634aaebb43d272e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57c0c70cc04f4c73ae2bc598047c15e5"
I20260807 18:14:27.305779 24870 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57c0c70cc04f4c73ae2bc598047c15e5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:27.308305 24870 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 57c0c70cc04f4c73ae2bc598047c15e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f33b01addea43bbb634aaebb43d272e in term 1.
I20260807 18:14:27.308853 24934 leader_election.cc:302] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 57c0c70cc04f4c73ae2bc598047c15e5, 8f33b01addea43bbb634aaebb43d272e; no voters:
I20260807 18:14:27.309377 25014 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:27.312165 25014 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [term 1 LEADER]: Becoming Leader. State: Replica: 8f33b01addea43bbb634aaebb43d272e, State: Running, Role: LEADER
I20260807 18:14:27.312804 25014 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c0c70cc04f4c73ae2bc598047c15e5" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 38815 } } peers { permanent_uuid: "8f33b01addea43bbb634aaebb43d272e" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 44749 } }
I20260807 18:14:27.316852 25053 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f33b01addea43bbb634aaebb43d272e. Latest consensus state: current_term: 1 leader_uuid: "8f33b01addea43bbb634aaebb43d272e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c0c70cc04f4c73ae2bc598047c15e5" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 38815 } } peers { permanent_uuid: "8f33b01addea43bbb634aaebb43d272e" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 44749 } } }
I20260807 18:14:27.317250 25053 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [sys.catalog]: This master's current role is: LEADER
I20260807 18:14:27.322088 25055 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:14:27.323879 25055 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:14:27.331329 24870 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 57c0c70cc04f4c73ae2bc598047c15e5 [term 1 FOLLOWER]: Refusing update from remote peer 8f33b01addea43bbb634aaebb43d272e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:14:27.332327 25053 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [LEADER]: Connected to new peer: Peer: permanent_uuid: "57c0c70cc04f4c73ae2bc598047c15e5" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 38815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:14:27.342859 25034 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57c0c70cc04f4c73ae2bc598047c15e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f33b01addea43bbb634aaebb43d272e. Latest consensus state: current_term: 1 leader_uuid: "8f33b01addea43bbb634aaebb43d272e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c0c70cc04f4c73ae2bc598047c15e5" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 38815 } } peers { permanent_uuid: "8f33b01addea43bbb634aaebb43d272e" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 44749 } } }
I20260807 18:14:27.343209 25034 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57c0c70cc04f4c73ae2bc598047c15e5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:27.347246 25056 mvcc.cc:205] Tried to move back new op lower bound from 7315974010179121152 to 7315974010117128192. Current Snapshot: MvccSnapshot[applied={T|T < 7315974010179121152}]
I20260807 18:14:27.350049 25057 mvcc.cc:205] Tried to move back new op lower bound from 7315974010179121152 to 7315974010117128192. Current Snapshot: MvccSnapshot[applied={T|T < 7315974010179121152}]
I20260807 18:14:27.350020 25053 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8f33b01addea43bbb634aaebb43d272e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c0c70cc04f4c73ae2bc598047c15e5" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 38815 } } peers { permanent_uuid: "8f33b01addea43bbb634aaebb43d272e" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 44749 } } }
I20260807 18:14:27.350299 25053 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e [sys.catalog]: This master's current role is: LEADER
I20260807 18:14:27.351071 25034 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57c0c70cc04f4c73ae2bc598047c15e5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8f33b01addea43bbb634aaebb43d272e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c0c70cc04f4c73ae2bc598047c15e5" member_type: VOTER last_known_addr { host: "127.19.201.62" port: 38815 } } peers { permanent_uuid: "8f33b01addea43bbb634aaebb43d272e" member_type: VOTER last_known_addr { host: "127.19.201.61" port: 44749 } } }
I20260807 18:14:27.351285 25034 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57c0c70cc04f4c73ae2bc598047c15e5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:14:27.355016 25055 catalog_manager.cc:1347] Generated new cluster ID: f7cf9bdfba36416fb6902d4e1e48f74b
I20260807 18:14:27.355122 25055 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:14:27.375936 25055 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:14:27.377624 25055 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:14:27.398066 25055 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e: Generated new TSK 0
I20260807 18:14:27.399201 25055 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:14:27.428702 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.201.1:0
--local_ip_for_outbound_sockets=127.19.201.1
--webserver_interface=127.19.201.1
--webserver_port=0
--tserver_master_addrs=127.19.201.62:38815,127.19.201.61:44749
--builtin_ntp_servers=127.19.201.20:44981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20260807 18:14:27.472707 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000119
I20260807 18:14:27.511857 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000069
I20260807 18:14:27.544173 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.070s user 0.035s sys 0.012s Metrics: {"bytes_written":6029,"cfile_init":1,"compiler_manager_pool.queue_time_us":51505,"compiler_manager_pool.run_cpu_time_us":27,"compiler_manager_pool.run_wall_time_us":27,"dirs.queue_time_us":5576,"dirs.run_cpu_time_us":230,"dirs.run_wall_time_us":1945,"drs_written":1,"lbm_read_time_us":112,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1203,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":3,"thread_start_us":5434,"threads_started":1}
I20260807 18:14:27.546630 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 185 bytes on disk
I20260807 18:14:27.547833 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.001s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":137,"lbm_reads_lt_1ms":4}
I20260807 18:14:27.594491 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.082s user 0.013s sys 0.031s Metrics: {"bytes_written":6029,"cfile_init":1,"dirs.queue_time_us":523,"dirs.run_cpu_time_us":243,"dirs.run_wall_time_us":992,"drs_written":1,"lbm_read_time_us":102,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1297,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":3,"thread_start_us":319,"threads_started":1}
I20260807 18:14:27.596102 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 185 bytes on disk
I20260807 18:14:27.597059 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":105,"lbm_reads_lt_1ms":4}
W20260807 18:14:27.818409 25062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:14:27.818711 25062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:14:27.818794 25062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:14:27.825984 25062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:14:27.826153 25062 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.201.1
I20260807 18:14:27.835188 25062 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:44981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.201.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.201.1
--webserver_port=0
--tserver_master_addrs=127.19.201.62:38815,127.19.201.61:44749
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.201.1
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
I20260807 18:14:27.836527 25062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:14:27.838370 25062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:14:27.853583 25072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:27.853695 25073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:14:27.853720 25075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:14:27.854672 25062 server_base.cc:1034] running on GCE node
I20260807 18:14:27.855340 25062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:14:27.856426 25062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:14:27.857724 25062 hybrid_clock.cc:648] HybridClock initialized: now 1786126467857644 us; error 52 us; skew 500 ppm
I20260807 18:14:27.858053 25062 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:14:27.860560 25062 webserver.cc:460] Webserver started at http://127.19.201.1:40451/ using document root <none> and password file <none>
I20260807 18:14:27.861383 25062 fs_manager.cc:359] Metadata directory not provided
I20260807 18:14:27.861562 25062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:14:27.861910 25062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:14:27.864748 25062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/ts-0/data/instance:
uuid: "62b8055ca6414187bd84f9b8d9b08741"
format_stamp: "Formatted at 2026-08-07 18:14:27 on dist-test-slave-bw88"
I20260807 18:14:27.865643 25062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/ts-0/wal/instance:
uuid: "62b8055ca6414187bd84f9b8d9b08741"
format_stamp: "Formatted at 2026-08-07 18:14:27 on dist-test-slave-bw88"
I20260807 18:14:27.871650 25062 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 18:14:27.875371 25084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:14:27.876794 25062 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 18:14:27.876987 25062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/ts-0/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/ts-0/wal
uuid: "62b8055ca6414187bd84f9b8d9b08741"
format_stamp: "Formatted at 2026-08-07 18:14:27 on dist-test-slave-bw88"
I20260807 18:14:27.877202 25062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:14:27.899245 25062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:14:27.900167 25062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:14:27.900604 25062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:14:27.901746 25062 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:14:27.903398 25062 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:14:27.903513 25062 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:14:27.903674 25062 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:14:27.903751 25062 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:14:27.939921 25062 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.1:45829
I20260807 18:14:27.940021 25239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.1:45829 every 8 connection(s)
I20260807 18:14:27.941390 25062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/ts-0/data/info.pb
I20260807 18:14:27.943087 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 25062
I20260807 18:14:27.943286 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/ts-0/wal/instance
I20260807 18:14:27.959013 25242 heartbeater.cc:347] Connected to a master server at 127.19.201.62:38815
I20260807 18:14:27.959062 25241 heartbeater.cc:347] Connected to a master server at 127.19.201.61:44749
I20260807 18:14:27.959374 25242 heartbeater.cc:464] Registering TS with master...
I20260807 18:14:27.959378 25241 heartbeater.cc:464] Registering TS with master...
I20260807 18:14:27.960260 25242 heartbeater.cc:511] Master 127.19.201.62:38815 requested a full tablet report, sending...
I20260807 18:14:27.960304 25241 heartbeater.cc:511] Master 127.19.201.61:44749 requested a full tablet report, sending...
I20260807 18:14:27.962679 24855 ts_manager.cc:194] Registered new tserver with Master: 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1:45829)
I20260807 18:14:27.962679 24957 ts_manager.cc:194] Registered new tserver with Master: 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1:45829)
I20260807 18:14:27.964165 24957 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.201.1:41745
I20260807 18:14:27.967597 20260 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20260807 18:14:27.972911 20260 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20260807 18:14:28.016844 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49210:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:28.049299 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000140
I20260807 18:14:28.051849 25147 tablet_service.cc:1467] Processing CreateTablet for tablet a20ef093718c4db4b8a4c05b8ed4e37c (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.1 [id=528ad8fc93d648e9a4c6f65101263233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:28.053216 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a20ef093718c4db4b8a4c05b8ed4e37c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:28.060163 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.010s user 0.008s sys 0.000s Metrics: {"bytes_written":5156,"cfile_init":1,"dirs.queue_time_us":472,"dirs.run_cpu_time_us":237,"dirs.run_wall_time_us":2161,"drs_written":1,"lbm_read_time_us":109,"lbm_reads_lt_1ms":4,"lbm_write_time_us":687,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2,"thread_start_us":280,"threads_started":1}
I20260807 18:14:28.061558 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.014997
I20260807 18:14:28.066063 25269 tablet_bootstrap.cc:492] T a20ef093718c4db4b8a4c05b8ed4e37c P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:28.069639 25269 tablet_bootstrap.cc:654] T a20ef093718c4db4b8a4c05b8ed4e37c P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:28.070915 25269 log.cc:824] T a20ef093718c4db4b8a4c05b8ed4e37c P 62b8055ca6414187bd84f9b8d9b08741: Log is configured to *not* fsync() on all Append() calls
I20260807 18:14:28.074146 25269 tablet_bootstrap.cc:492] T a20ef093718c4db4b8a4c05b8ed4e37c P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:28.074430 25269 ts_tablet_manager.cc:1397] T a20ef093718c4db4b8a4c05b8ed4e37c P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.006s
I20260807 18:14:28.082830 25269 raft_consensus.cc:348] T a20ef093718c4db4b8a4c05b8ed4e37c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.083312 25269 raft_consensus.cc:374] T a20ef093718c4db4b8a4c05b8ed4e37c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:28.083441 25269 raft_consensus.cc:729] T a20ef093718c4db4b8a4c05b8ed4e37c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:28.083042 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.021s user 0.017s sys 0.004s Metrics: {"bytes_written":6453,"cfile_cache_hit":12,"cfile_cache_hit_bytes":1878,"cfile_cache_miss":28,"cfile_cache_miss_bytes":2674,"cfile_init":8,"delta_iterators_relevant":4,"dirs.queue_time_us":2187,"dirs.run_cpu_time_us":1056,"dirs.run_wall_time_us":4717,"drs_written":1,"lbm_read_time_us":970,"lbm_reads_lt_1ms":60,"lbm_write_time_us":630,"lbm_writes_lt_1ms":27,"mutex_wait_us":32,"num_input_rowsets":2,"peak_mem_usage":50,"rows_written":5,"thread_start_us":1284,"threads_started":4}
I20260807 18:14:28.084143 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 275 bytes on disk
I20260807 18:14:28.084200 25269 consensus_queue.cc:260] T a20ef093718c4db4b8a4c05b8ed4e37c P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.084532 25269 raft_consensus.cc:388] T a20ef093718c4db4b8a4c05b8ed4e37c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:28.084688 25269 raft_consensus.cc:482] T a20ef093718c4db4b8a4c05b8ed4e37c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:28.084930 25269 raft_consensus.cc:3037] T a20ef093718c4db4b8a4c05b8ed4e37c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:28.084905 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":138,"lbm_reads_lt_1ms":4}
I20260807 18:14:28.087271 25269 raft_consensus.cc:504] T a20ef093718c4db4b8a4c05b8ed4e37c P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.087847 25269 leader_election.cc:302] T a20ef093718c4db4b8a4c05b8ed4e37c P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:28.088454 25269 leader_election.cc:288] T a20ef093718c4db4b8a4c05b8ed4e37c P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:28.088627 25275 raft_consensus.cc:2781] T a20ef093718c4db4b8a4c05b8ed4e37c P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:28.089608 25241 heartbeater.cc:503] Master 127.19.201.61:44749 was elected leader, sending a full tablet report...
I20260807 18:14:28.089972 25275 raft_consensus.cc:686] T a20ef093718c4db4b8a4c05b8ed4e37c P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:28.090584 25275 consensus_queue.cc:237] T a20ef093718c4db4b8a4c05b8ed4e37c P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.091117 25269 ts_tablet_manager.cc:1428] T a20ef093718c4db4b8a4c05b8ed4e37c P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.017s user 0.003s sys 0.013s
I20260807 18:14:28.096087 24957 catalog_manager.cc:5495] T a20ef093718c4db4b8a4c05b8ed4e37c P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:28.098503 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000140
I20260807 18:14:28.112004 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.013s user 0.006s sys 0.004s Metrics: {"bytes_written":334,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":387,"dirs.run_cpu_time_us":207,"dirs.run_wall_time_us":1477,"drs_written":1,"lbm_read_time_us":126,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1101,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":2,"thread_start_us":249,"threads_started":1,"update_count":1}
I20260807 18:14:28.113279 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.463245
I20260807 18:14:28.124871 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.011s user 0.006s sys 0.005s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":576,"cfile_init":5,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":570,"lbm_read_time_us":438,"lbm_reads_lt_1ms":25,"lbm_write_time_us":219,"lbm_writes_lt_1ms":9,"reinsert_count":0,"thread_start_us":324,"threads_started":1,"update_count":1}
I20260807 18:14:28.125576 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 235 bytes on disk
I20260807 18:14:28.126109 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":58,"lbm_reads_lt_1ms":4}
I20260807 18:14:28.126729 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.014997
I20260807 18:14:28.143046 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49224:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:28.149519 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.023s user 0.018s sys 0.004s Metrics: {"bytes_written":6490,"cfile_cache_hit":13,"cfile_cache_hit_bytes":1949,"cfile_cache_miss":31,"cfile_cache_miss_bytes":3133,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":4582,"dirs.run_cpu_time_us":1027,"dirs.run_wall_time_us":6717,"drs_written":1,"lbm_read_time_us":1003,"lbm_reads_lt_1ms":63,"lbm_write_time_us":891,"lbm_writes_lt_1ms":27,"mutex_wait_us":52,"num_input_rowsets":2,"peak_mem_usage":50,"rows_written":5,"thread_start_us":2756,"threads_started":3}
I20260807 18:14:28.150552 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 393 bytes on disk
I20260807 18:14:28.151196 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":97,"lbm_reads_lt_1ms":4}
I20260807 18:14:28.151885 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000011
I20260807 18:14:28.157990 25147 tablet_service.cc:1467] Processing CreateTablet for tablet d58cf6316b3f49e5a1ce18added6bd08 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.2 [id=b4b9ff74f64b48e0b1f7398d41b93a09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:28.158501 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d58cf6316b3f49e5a1ce18added6bd08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:28.164903 25269 tablet_bootstrap.cc:492] T d58cf6316b3f49e5a1ce18added6bd08 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:28.165838 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.013s user 0.013s sys 0.000s Metrics: {"bytes_written":329,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":133,"dirs.run_cpu_time_us":221,"dirs.run_wall_time_us":1257,"drs_written":1,"lbm_read_time_us":77,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1103,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":2,"update_count":1}
I20260807 18:14:28.166778 25269 tablet_bootstrap.cc:654] T d58cf6316b3f49e5a1ce18added6bd08 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:28.168064 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 167 bytes on disk
I20260807 18:14:28.168740 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":108,"lbm_reads_lt_1ms":4}
I20260807 18:14:28.169428 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.541118
I20260807 18:14:28.170077 25269 tablet_bootstrap.cc:492] T d58cf6316b3f49e5a1ce18added6bd08 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:28.170245 25269 ts_tablet_manager.cc:1397] T d58cf6316b3f49e5a1ce18added6bd08 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 18:14:28.171087 25269 raft_consensus.cc:348] T d58cf6316b3f49e5a1ce18added6bd08 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.171273 25269 raft_consensus.cc:374] T d58cf6316b3f49e5a1ce18added6bd08 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:28.171388 25269 raft_consensus.cc:729] T d58cf6316b3f49e5a1ce18added6bd08 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:28.171624 25269 consensus_queue.cc:260] T d58cf6316b3f49e5a1ce18added6bd08 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.171823 25269 raft_consensus.cc:388] T d58cf6316b3f49e5a1ce18added6bd08 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:28.171923 25269 raft_consensus.cc:482] T d58cf6316b3f49e5a1ce18added6bd08 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:28.172053 25269 raft_consensus.cc:3037] T d58cf6316b3f49e5a1ce18added6bd08 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:28.174304 25269 raft_consensus.cc:504] T d58cf6316b3f49e5a1ce18added6bd08 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.174571 25269 leader_election.cc:302] T d58cf6316b3f49e5a1ce18added6bd08 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:28.174767 25269 leader_election.cc:288] T d58cf6316b3f49e5a1ce18added6bd08 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:28.174854 25275 raft_consensus.cc:2781] T d58cf6316b3f49e5a1ce18added6bd08 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:28.175057 25275 raft_consensus.cc:686] T d58cf6316b3f49e5a1ce18added6bd08 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:28.175232 25269 ts_tablet_manager.cc:1428] T d58cf6316b3f49e5a1ce18added6bd08 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.002s sys 0.002s
I20260807 18:14:28.175303 25275 consensus_queue.cc:237] T d58cf6316b3f49e5a1ce18added6bd08 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.177971 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.008s user 0.008s sys 0.000s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":458,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":50,"lbm_read_time_us":299,"lbm_reads_lt_1ms":21,"lbm_write_time_us":238,"lbm_writes_lt_1ms":9,"mutex_wait_us":27,"reinsert_count":0,"spinlock_wait_cycles":7552,"update_count":1}
I20260807 18:14:28.178088 24957 catalog_manager.cc:5495] T d58cf6316b3f49e5a1ce18added6bd08 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:28.178591 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.441749
I20260807 18:14:28.200876 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.022s user 0.018s sys 0.004s Metrics: {"bytes_written":336,"cfile_cache_hit":13,"cfile_cache_hit_bytes":2282,"cfile_cache_miss":31,"cfile_cache_miss_bytes":3514,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":6,"dirs.queue_time_us":2243,"dirs.run_cpu_time_us":883,"dirs.run_wall_time_us":5130,"drs_written":1,"lbm_read_time_us":1177,"lbm_reads_lt_1ms":63,"lbm_write_time_us":1229,"lbm_writes_lt_1ms":31,"mutex_wait_us":492,"num_input_rowsets":2,"peak_mem_usage":304,"reinsert_count":0,"rows_written":7,"spinlock_wait_cycles":9216,"thread_start_us":915,"threads_started":1,"update_count":1}
I20260807 18:14:28.201821 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 461 bytes on disk
I20260807 18:14:28.202351 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":61,"lbm_reads_lt_1ms":4}
I20260807 18:14:28.202867 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.142313
I20260807 18:14:28.210033 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49228:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:28.212049 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.009s user 0.006s sys 0.000s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":2118,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":91,"lbm_read_time_us":419,"lbm_reads_lt_1ms":21,"lbm_write_time_us":319,"lbm_writes_lt_1ms":9,"reinsert_count":0,"update_count":1}
I20260807 18:14:28.221900 25147 tablet_service.cc:1467] Processing CreateTablet for tablet bbade79cd7154b3498c4497cd0219124 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.3 [id=fc772a8a9a4746d3a48ca855dcb33bb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:28.222456 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbade79cd7154b3498c4497cd0219124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:28.227419 25269 tablet_bootstrap.cc:492] T bbade79cd7154b3498c4497cd0219124 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:28.228856 25269 tablet_bootstrap.cc:654] T bbade79cd7154b3498c4497cd0219124 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:28.231941 25269 tablet_bootstrap.cc:492] T bbade79cd7154b3498c4497cd0219124 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:28.232146 25269 ts_tablet_manager.cc:1397] T bbade79cd7154b3498c4497cd0219124 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 18:14:28.232775 25269 raft_consensus.cc:348] T bbade79cd7154b3498c4497cd0219124 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.232996 25269 raft_consensus.cc:374] T bbade79cd7154b3498c4497cd0219124 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:28.233104 25269 raft_consensus.cc:729] T bbade79cd7154b3498c4497cd0219124 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:28.233408 25269 consensus_queue.cc:260] T bbade79cd7154b3498c4497cd0219124 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.233629 25269 raft_consensus.cc:388] T bbade79cd7154b3498c4497cd0219124 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:28.233757 25269 raft_consensus.cc:482] T bbade79cd7154b3498c4497cd0219124 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:28.233879 25269 raft_consensus.cc:3037] T bbade79cd7154b3498c4497cd0219124 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:28.235767 25269 raft_consensus.cc:504] T bbade79cd7154b3498c4497cd0219124 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.236047 25269 leader_election.cc:302] T bbade79cd7154b3498c4497cd0219124 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:28.236270 25269 leader_election.cc:288] T bbade79cd7154b3498c4497cd0219124 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:28.236513 25275 raft_consensus.cc:2781] T bbade79cd7154b3498c4497cd0219124 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:28.236699 25275 raft_consensus.cc:686] T bbade79cd7154b3498c4497cd0219124 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:28.236822 25269 ts_tablet_manager.cc:1428] T bbade79cd7154b3498c4497cd0219124 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260807 18:14:28.236975 25275 consensus_queue.cc:237] T bbade79cd7154b3498c4497cd0219124 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.239710 24956 catalog_manager.cc:5495] T bbade79cd7154b3498c4497cd0219124 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:28.268450 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49242:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:28.278191 25050 catalog_manager.cc:1259] Loaded cluster ID: f7cf9bdfba36416fb6902d4e1e48f74b
I20260807 18:14:28.278311 25050 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 57c0c70cc04f4c73ae2bc598047c15e5: loading cluster ID for follower catalog manager: success
I20260807 18:14:28.280706 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 6c0c6298c3614d10b7d80be3906b1959 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.4 [id=82e9685078ef4ba38c4d70736f47e3ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:28.281286 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c0c6298c3614d10b7d80be3906b1959. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:28.282833 25050 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 57c0c70cc04f4c73ae2bc598047c15e5: acquiring CA information for follower catalog manager: success
I20260807 18:14:28.286173 25269 tablet_bootstrap.cc:492] T 6c0c6298c3614d10b7d80be3906b1959 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:28.286168 25050 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 57c0c70cc04f4c73ae2bc598047c15e5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 18:14:28.287668 25269 tablet_bootstrap.cc:654] T 6c0c6298c3614d10b7d80be3906b1959 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:28.289740 25269 tablet_bootstrap.cc:492] T 6c0c6298c3614d10b7d80be3906b1959 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:28.289858 25269 ts_tablet_manager.cc:1397] T 6c0c6298c3614d10b7d80be3906b1959 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260807 18:14:28.290405 25269 raft_consensus.cc:348] T 6c0c6298c3614d10b7d80be3906b1959 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.290560 25269 raft_consensus.cc:374] T 6c0c6298c3614d10b7d80be3906b1959 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:28.290622 25269 raft_consensus.cc:729] T 6c0c6298c3614d10b7d80be3906b1959 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:28.290868 25269 consensus_queue.cc:260] T 6c0c6298c3614d10b7d80be3906b1959 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.291088 25269 raft_consensus.cc:388] T 6c0c6298c3614d10b7d80be3906b1959 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:28.291181 25269 raft_consensus.cc:482] T 6c0c6298c3614d10b7d80be3906b1959 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:28.291287 25269 raft_consensus.cc:3037] T 6c0c6298c3614d10b7d80be3906b1959 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:28.293080 25269 raft_consensus.cc:504] T 6c0c6298c3614d10b7d80be3906b1959 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.293387 25269 leader_election.cc:302] T 6c0c6298c3614d10b7d80be3906b1959 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:28.293591 25269 leader_election.cc:288] T 6c0c6298c3614d10b7d80be3906b1959 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:28.293764 25275 raft_consensus.cc:2781] T 6c0c6298c3614d10b7d80be3906b1959 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:28.293989 25275 raft_consensus.cc:686] T 6c0c6298c3614d10b7d80be3906b1959 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:28.294130 25269 ts_tablet_manager.cc:1428] T 6c0c6298c3614d10b7d80be3906b1959 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.004s user 0.002s sys 0.002s
I20260807 18:14:28.294209 25275 consensus_queue.cc:237] T 6c0c6298c3614d10b7d80be3906b1959 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.296721 24956 catalog_manager.cc:5495] T 6c0c6298c3614d10b7d80be3906b1959 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:28.325697 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49252:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:28.336277 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000077
I20260807 18:14:28.337786 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 982462876fef40348b47e09469dcaebe (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.5 [id=70afde70f2c84a87a12086be8af08409]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:28.338203 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 982462876fef40348b47e09469dcaebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:28.343674 25269 tablet_bootstrap.cc:492] T 982462876fef40348b47e09469dcaebe P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:28.345129 25269 tablet_bootstrap.cc:654] T 982462876fef40348b47e09469dcaebe P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:28.346580 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.010s user 0.009s sys 0.000s Metrics: {"bytes_written":6455,"cfile_init":1,"dirs.queue_time_us":70,"dirs.run_cpu_time_us":182,"dirs.run_wall_time_us":1663,"drs_written":1,"lbm_read_time_us":87,"lbm_reads_lt_1ms":4,"lbm_write_time_us":636,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":8}
I20260807 18:14:28.347589 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 586 bytes on disk
I20260807 18:14:28.348376 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":115,"lbm_reads_lt_1ms":4}
I20260807 18:14:28.348685 25269 tablet_bootstrap.cc:492] T 982462876fef40348b47e09469dcaebe P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:28.348868 25269 ts_tablet_manager.cc:1397] T 982462876fef40348b47e09469dcaebe P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260807 18:14:28.349471 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.590377
I20260807 18:14:28.349576 25269 raft_consensus.cc:348] T 982462876fef40348b47e09469dcaebe P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.349839 25269 raft_consensus.cc:374] T 982462876fef40348b47e09469dcaebe P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:28.349974 25269 raft_consensus.cc:729] T 982462876fef40348b47e09469dcaebe P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:28.350287 25269 consensus_queue.cc:260] T 982462876fef40348b47e09469dcaebe P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.350533 25269 raft_consensus.cc:388] T 982462876fef40348b47e09469dcaebe P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:28.350680 25269 raft_consensus.cc:482] T 982462876fef40348b47e09469dcaebe P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:28.350832 25269 raft_consensus.cc:3037] T 982462876fef40348b47e09469dcaebe P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:28.353572 25269 raft_consensus.cc:504] T 982462876fef40348b47e09469dcaebe P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.353853 25269 leader_election.cc:302] T 982462876fef40348b47e09469dcaebe P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:28.354095 25269 leader_election.cc:288] T 982462876fef40348b47e09469dcaebe P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:28.354224 25275 raft_consensus.cc:2781] T 982462876fef40348b47e09469dcaebe P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:28.354480 25275 raft_consensus.cc:686] T 982462876fef40348b47e09469dcaebe P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:28.354837 25275 consensus_queue.cc:237] T 982462876fef40348b47e09469dcaebe P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.354962 25269 ts_tablet_manager.cc:1428] T 982462876fef40348b47e09469dcaebe P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260807 18:14:28.358763 24957 catalog_manager.cc:5495] T 982462876fef40348b47e09469dcaebe P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:28.371948 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.022s user 0.021s sys 0.000s Metrics: {"bytes_written":8222,"cfile_cache_hit":12,"cfile_cache_hit_bytes":3305,"cfile_cache_miss":28,"cfile_cache_miss_bytes":4963,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":1384,"dirs.run_cpu_time_us":1349,"dirs.run_wall_time_us":6200,"drs_written":1,"lbm_read_time_us":1079,"lbm_reads_lt_1ms":56,"lbm_write_time_us":983,"lbm_writes_lt_1ms":27,"mutex_wait_us":247,"num_input_rowsets":2,"peak_mem_usage":132,"rows_written":13,"spinlock_wait_cycles":768,"thread_start_us":957,"threads_started":2}
I20260807 18:14:28.373221 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 701 bytes on disk
I20260807 18:14:28.373843 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":67,"lbm_reads_lt_1ms":4}
I20260807 18:14:28.374486 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.000002
I20260807 18:14:28.379211 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.004s user 0.001s sys 0.001s Metrics: {"bytes_written":389,"delete_count":0,"lbm_write_time_us":117,"lbm_writes_lt_1ms":4,"reinsert_count":0,"update_count":2}
I20260807 18:14:28.379748 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.111270
I20260807 18:14:28.390432 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.010s user 0.002s sys 0.008s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":3081,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":174,"lbm_read_time_us":489,"lbm_reads_lt_1ms":21,"lbm_write_time_us":248,"lbm_writes_lt_1ms":9,"reinsert_count":0,"update_count":2}
I20260807 18:14:28.404922 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49258:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:28.416769 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 3802a32f97954344869193bb9232d8bf (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.6 [id=f580b335e4fb404eaf357bdd6ce147da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:28.417299 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3802a32f97954344869193bb9232d8bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:28.422366 25269 tablet_bootstrap.cc:492] T 3802a32f97954344869193bb9232d8bf P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:28.423779 25269 tablet_bootstrap.cc:654] T 3802a32f97954344869193bb9232d8bf P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:28.425886 25269 tablet_bootstrap.cc:492] T 3802a32f97954344869193bb9232d8bf P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:28.426008 25269 ts_tablet_manager.cc:1397] T 3802a32f97954344869193bb9232d8bf P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260807 18:14:28.426590 25269 raft_consensus.cc:348] T 3802a32f97954344869193bb9232d8bf P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.426746 25269 raft_consensus.cc:374] T 3802a32f97954344869193bb9232d8bf P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:28.426815 25269 raft_consensus.cc:729] T 3802a32f97954344869193bb9232d8bf P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:28.426978 25269 consensus_queue.cc:260] T 3802a32f97954344869193bb9232d8bf P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.427120 25269 raft_consensus.cc:388] T 3802a32f97954344869193bb9232d8bf P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:28.427177 25269 raft_consensus.cc:482] T 3802a32f97954344869193bb9232d8bf P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:28.427261 25269 raft_consensus.cc:3037] T 3802a32f97954344869193bb9232d8bf P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:28.429175 25269 raft_consensus.cc:504] T 3802a32f97954344869193bb9232d8bf P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.429476 25269 leader_election.cc:302] T 3802a32f97954344869193bb9232d8bf P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:28.429666 25269 leader_election.cc:288] T 3802a32f97954344869193bb9232d8bf P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:28.429739 25275 raft_consensus.cc:2781] T 3802a32f97954344869193bb9232d8bf P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:28.429922 25275 raft_consensus.cc:686] T 3802a32f97954344869193bb9232d8bf P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:28.430145 25275 consensus_queue.cc:237] T 3802a32f97954344869193bb9232d8bf P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.430444 25269 ts_tablet_manager.cc:1428] T 3802a32f97954344869193bb9232d8bf P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260807 18:14:28.432782 24957 catalog_manager.cc:5495] T 3802a32f97954344869193bb9232d8bf P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:28.462958 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000083
I20260807 18:14:28.466864 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49274:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:28.477312 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.014s user 0.010s sys 0.000s Metrics: {"bytes_written":6491,"cfile_init":1,"dirs.queue_time_us":53,"dirs.run_cpu_time_us":214,"dirs.run_wall_time_us":1460,"drs_written":1,"lbm_read_time_us":119,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1019,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":8}
I20260807 18:14:28.478508 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.557349
I20260807 18:14:28.480031 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 09ecf22b735045dca9bfbfe5275b63bc (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.7 [id=c193b704936b4eb398743967d98731dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:28.480585 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09ecf22b735045dca9bfbfe5275b63bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:28.486426 25269 tablet_bootstrap.cc:492] T 09ecf22b735045dca9bfbfe5275b63bc P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:28.488351 25269 tablet_bootstrap.cc:654] T 09ecf22b735045dca9bfbfe5275b63bc P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:28.490767 25269 tablet_bootstrap.cc:492] T 09ecf22b735045dca9bfbfe5275b63bc P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:28.490958 25269 ts_tablet_manager.cc:1397] T 09ecf22b735045dca9bfbfe5275b63bc P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 18:14:28.491827 25269 raft_consensus.cc:348] T 09ecf22b735045dca9bfbfe5275b63bc P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.492096 25269 raft_consensus.cc:374] T 09ecf22b735045dca9bfbfe5275b63bc P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:28.492235 25269 raft_consensus.cc:729] T 09ecf22b735045dca9bfbfe5275b63bc P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:28.492570 25269 consensus_queue.cc:260] T 09ecf22b735045dca9bfbfe5275b63bc P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.492772 25269 raft_consensus.cc:388] T 09ecf22b735045dca9bfbfe5275b63bc P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:28.492878 25269 raft_consensus.cc:482] T 09ecf22b735045dca9bfbfe5275b63bc P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:28.492980 25269 raft_consensus.cc:3037] T 09ecf22b735045dca9bfbfe5275b63bc P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:28.495836 25269 raft_consensus.cc:504] T 09ecf22b735045dca9bfbfe5275b63bc P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.496098 25269 leader_election.cc:302] T 09ecf22b735045dca9bfbfe5275b63bc P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:28.496369 25269 leader_election.cc:288] T 09ecf22b735045dca9bfbfe5275b63bc P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:28.496526 25275 raft_consensus.cc:2781] T 09ecf22b735045dca9bfbfe5275b63bc P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:28.496711 25275 raft_consensus.cc:686] T 09ecf22b735045dca9bfbfe5275b63bc P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:28.496914 25269 ts_tablet_manager.cc:1428] T 09ecf22b735045dca9bfbfe5275b63bc P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260807 18:14:28.497006 25275 consensus_queue.cc:237] T 09ecf22b735045dca9bfbfe5275b63bc P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.499203 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.020s user 0.019s sys 0.000s Metrics: {"bytes_written":8689,"cfile_cache_hit":24,"cfile_cache_hit_bytes":6120,"cfile_cache_miss":20,"cfile_cache_miss_bytes":3934,"cfile_init":5,"delta_iterators_relevant":6,"dirs.queue_time_us":1312,"dirs.run_cpu_time_us":1035,"dirs.run_wall_time_us":5722,"drs_written":1,"lbm_read_time_us":700,"lbm_reads_lt_1ms":40,"lbm_write_time_us":923,"lbm_writes_lt_1ms":27,"mutex_wait_us":172,"num_input_rowsets":2,"peak_mem_usage":575,"rows_written":15,"spinlock_wait_cycles":1792,"thread_start_us":653,"threads_started":1}
I20260807 18:14:28.500293 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 818 bytes on disk
I20260807 18:14:28.500911 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":61,"lbm_reads_lt_1ms":4}
I20260807 18:14:28.501650 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000007
I20260807 18:14:28.503799 24957 catalog_manager.cc:5495] T 09ecf22b735045dca9bfbfe5275b63bc P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:28.515211 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.013s user 0.006s sys 0.004s Metrics: {"bytes_written":5156,"cfile_init":1,"dirs.queue_time_us":68,"dirs.run_cpu_time_us":164,"dirs.run_wall_time_us":1494,"drs_written":1,"lbm_read_time_us":88,"lbm_reads_lt_1ms":4,"lbm_write_time_us":911,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:28.516135 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 235 bytes on disk
I20260807 18:14:28.516729 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":72,"lbm_reads_lt_1ms":4}
I20260807 18:14:28.517477 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.280506
I20260807 18:14:28.538026 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.020s user 0.015s sys 0.005s Metrics: {"bytes_written":9151,"cfile_cache_hit":12,"cfile_cache_hit_bytes":4080,"cfile_cache_miss":28,"cfile_cache_miss_bytes":6180,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":301,"dirs.run_cpu_time_us":183,"dirs.run_wall_time_us":1920,"drs_written":1,"lbm_read_time_us":1052,"lbm_reads_lt_1ms":56,"lbm_write_time_us":1048,"lbm_writes_lt_1ms":27,"mutex_wait_us":26,"num_input_rowsets":2,"peak_mem_usage":1779,"rows_written":17,"spinlock_wait_cycles":2816}
I20260807 18:14:28.538813 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 898 bytes on disk
I20260807 18:14:28.539191 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49276:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:28.539464 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":88,"lbm_reads_lt_1ms":4}
I20260807 18:14:28.551811 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 17d5ee9c199147bda753847ae52c1cb5 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.8 [id=83126869df784d52af35efaad4345ba6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:28.552269 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17d5ee9c199147bda753847ae52c1cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:28.557457 25269 tablet_bootstrap.cc:492] T 17d5ee9c199147bda753847ae52c1cb5 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:28.558786 25269 tablet_bootstrap.cc:654] T 17d5ee9c199147bda753847ae52c1cb5 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:28.561301 25269 tablet_bootstrap.cc:492] T 17d5ee9c199147bda753847ae52c1cb5 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:28.561566 25269 ts_tablet_manager.cc:1397] T 17d5ee9c199147bda753847ae52c1cb5 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.003s
I20260807 18:14:28.562386 25269 raft_consensus.cc:348] T 17d5ee9c199147bda753847ae52c1cb5 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.562654 25269 raft_consensus.cc:374] T 17d5ee9c199147bda753847ae52c1cb5 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:28.562798 25269 raft_consensus.cc:729] T 17d5ee9c199147bda753847ae52c1cb5 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:28.563097 25269 consensus_queue.cc:260] T 17d5ee9c199147bda753847ae52c1cb5 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.563331 25269 raft_consensus.cc:388] T 17d5ee9c199147bda753847ae52c1cb5 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:28.563454 25269 raft_consensus.cc:482] T 17d5ee9c199147bda753847ae52c1cb5 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:28.563606 25269 raft_consensus.cc:3037] T 17d5ee9c199147bda753847ae52c1cb5 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:28.566296 25269 raft_consensus.cc:504] T 17d5ee9c199147bda753847ae52c1cb5 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.566603 25269 leader_election.cc:302] T 17d5ee9c199147bda753847ae52c1cb5 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:28.566859 25269 leader_election.cc:288] T 17d5ee9c199147bda753847ae52c1cb5 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:28.567036 25275 raft_consensus.cc:2781] T 17d5ee9c199147bda753847ae52c1cb5 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:28.567270 25275 raft_consensus.cc:686] T 17d5ee9c199147bda753847ae52c1cb5 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:28.567492 25269 ts_tablet_manager.cc:1428] T 17d5ee9c199147bda753847ae52c1cb5 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260807 18:14:28.567507 25275 consensus_queue.cc:237] T 17d5ee9c199147bda753847ae52c1cb5 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.570633 24956 catalog_manager.cc:5495] T 17d5ee9c199147bda753847ae52c1cb5 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:28.600935 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49280:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:28.612876 25147 tablet_service.cc:1467] Processing CreateTablet for tablet dfb71fbfae2b408c90c176fce5a73385 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.9 [id=eccd7b373f5746bf872b82c391cf7158]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:28.613528 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfb71fbfae2b408c90c176fce5a73385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:28.618570 25269 tablet_bootstrap.cc:492] T dfb71fbfae2b408c90c176fce5a73385 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:28.620014 25269 tablet_bootstrap.cc:654] T dfb71fbfae2b408c90c176fce5a73385 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:28.622479 25269 tablet_bootstrap.cc:492] T dfb71fbfae2b408c90c176fce5a73385 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:28.622666 25269 ts_tablet_manager.cc:1397] T dfb71fbfae2b408c90c176fce5a73385 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20260807 18:14:28.623301 25269 raft_consensus.cc:348] T dfb71fbfae2b408c90c176fce5a73385 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.623538 25269 raft_consensus.cc:374] T dfb71fbfae2b408c90c176fce5a73385 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:28.623643 25269 raft_consensus.cc:729] T dfb71fbfae2b408c90c176fce5a73385 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:28.623906 25269 consensus_queue.cc:260] T dfb71fbfae2b408c90c176fce5a73385 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.624053 25269 raft_consensus.cc:388] T dfb71fbfae2b408c90c176fce5a73385 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:28.624184 25269 raft_consensus.cc:482] T dfb71fbfae2b408c90c176fce5a73385 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:28.624300 25269 raft_consensus.cc:3037] T dfb71fbfae2b408c90c176fce5a73385 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:28.626322 25269 raft_consensus.cc:504] T dfb71fbfae2b408c90c176fce5a73385 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.626572 25269 leader_election.cc:302] T dfb71fbfae2b408c90c176fce5a73385 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:28.626798 25269 leader_election.cc:288] T dfb71fbfae2b408c90c176fce5a73385 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:28.626863 25275 raft_consensus.cc:2781] T dfb71fbfae2b408c90c176fce5a73385 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:28.627002 25275 raft_consensus.cc:686] T dfb71fbfae2b408c90c176fce5a73385 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:28.627360 25269 ts_tablet_manager.cc:1428] T dfb71fbfae2b408c90c176fce5a73385 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 18:14:28.627249 25275 consensus_queue.cc:237] T dfb71fbfae2b408c90c176fce5a73385 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.629943 24957 catalog_manager.cc:5495] T dfb71fbfae2b408c90c176fce5a73385 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:28.641541 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000082
I20260807 18:14:28.654574 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.013s user 0.010s sys 0.001s Metrics: {"bytes_written":6492,"cfile_init":1,"dirs.queue_time_us":79,"dirs.run_cpu_time_us":212,"dirs.run_wall_time_us":1583,"drs_written":1,"lbm_read_time_us":80,"lbm_reads_lt_1ms":4,"lbm_write_time_us":857,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":8}
I20260807 18:14:28.655669 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 596 bytes on disk
I20260807 18:14:28.656850 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":110,"lbm_reads_lt_1ms":4}
I20260807 18:14:28.657842 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.483295
I20260807 18:14:28.663388 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49284:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:28.676719 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 9ab0e6a82f8b43128c06f2ce46ba1def (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.10 [id=006237d189d648d0bfd7b10da7e6616f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:28.677182 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ab0e6a82f8b43128c06f2ce46ba1def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:28.679438 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.021s user 0.017s sys 0.004s Metrics: {"bytes_written":10022,"cfile_cache_hit":13,"cfile_cache_hit_bytes":4881,"cfile_cache_miss":31,"cfile_cache_miss_bytes":7897,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":959,"dirs.run_cpu_time_us":520,"dirs.run_wall_time_us":2587,"drs_written":1,"lbm_read_time_us":1228,"lbm_reads_lt_1ms":63,"lbm_write_time_us":773,"lbm_writes_lt_1ms":27,"mutex_wait_us":294,"num_input_rowsets":2,"peak_mem_usage":1540,"rows_written":21,"spinlock_wait_cycles":2176}
I20260807 18:14:28.680281 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 1059 bytes on disk
I20260807 18:14:28.680855 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":62,"lbm_reads_lt_1ms":4}
I20260807 18:14:28.681533 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000007
I20260807 18:14:28.683168 25269 tablet_bootstrap.cc:492] T 9ab0e6a82f8b43128c06f2ce46ba1def P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:28.685004 25269 tablet_bootstrap.cc:654] T 9ab0e6a82f8b43128c06f2ce46ba1def P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:28.691061 25269 tablet_bootstrap.cc:492] T 9ab0e6a82f8b43128c06f2ce46ba1def P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:28.691228 25269 ts_tablet_manager.cc:1397] T 9ab0e6a82f8b43128c06f2ce46ba1def P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.007s
I20260807 18:14:28.692076 25269 raft_consensus.cc:348] T 9ab0e6a82f8b43128c06f2ce46ba1def P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.692287 25269 raft_consensus.cc:374] T 9ab0e6a82f8b43128c06f2ce46ba1def P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:28.692384 25269 raft_consensus.cc:729] T 9ab0e6a82f8b43128c06f2ce46ba1def P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:28.692631 25269 consensus_queue.cc:260] T 9ab0e6a82f8b43128c06f2ce46ba1def P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.692862 25269 raft_consensus.cc:388] T 9ab0e6a82f8b43128c06f2ce46ba1def P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:28.692958 25269 raft_consensus.cc:482] T 9ab0e6a82f8b43128c06f2ce46ba1def P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:28.693061 25269 raft_consensus.cc:3037] T 9ab0e6a82f8b43128c06f2ce46ba1def P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:28.694826 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.013s user 0.011s sys 0.000s Metrics: {"bytes_written":5157,"cfile_init":1,"dirs.queue_time_us":64,"dirs.run_cpu_time_us":167,"dirs.run_wall_time_us":1099,"drs_written":1,"lbm_read_time_us":151,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1055,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:28.695866 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 235 bytes on disk
I20260807 18:14:28.695808 25269 raft_consensus.cc:504] T 9ab0e6a82f8b43128c06f2ce46ba1def P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.696120 25269 leader_election.cc:302] T 9ab0e6a82f8b43128c06f2ce46ba1def P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:28.696359 25269 leader_election.cc:288] T 9ab0e6a82f8b43128c06f2ce46ba1def P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:28.696435 25275 raft_consensus.cc:2781] T 9ab0e6a82f8b43128c06f2ce46ba1def P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:28.696610 25275 raft_consensus.cc:686] T 9ab0e6a82f8b43128c06f2ce46ba1def P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:28.696782 25269 ts_tablet_manager.cc:1428] T 9ab0e6a82f8b43128c06f2ce46ba1def P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.004s sys 0.002s
I20260807 18:14:28.696848 25275 consensus_queue.cc:237] T 9ab0e6a82f8b43128c06f2ce46ba1def P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.698817 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.003s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":159,"lbm_reads_lt_1ms":4}
I20260807 18:14:28.699483 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.282090
I20260807 18:14:28.699625 24957 catalog_manager.cc:5495] T 9ab0e6a82f8b43128c06f2ce46ba1def P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:28.720757 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.021s user 0.021s sys 0.000s Metrics: {"bytes_written":336,"cfile_cache_hit":12,"cfile_cache_hit_bytes":5190,"cfile_cache_miss":28,"cfile_cache_miss_bytes":7806,"cfile_init":7,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":711,"dirs.run_cpu_time_us":218,"dirs.run_wall_time_us":1154,"drs_written":1,"lbm_read_time_us":1136,"lbm_reads_lt_1ms":56,"lbm_write_time_us":799,"lbm_writes_lt_1ms":31,"mutex_wait_us":23,"num_input_rowsets":2,"peak_mem_usage":2542,"reinsert_count":0,"rows_written":23,"spinlock_wait_cycles":10752,"update_count":1}
I20260807 18:14:28.721817 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 1129 bytes on disk
I20260807 18:14:28.722374 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":61,"lbm_reads_lt_1ms":4}
I20260807 18:14:28.735584 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49288:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:28.748126 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 484e0d56f8274b218ea7db0586e7729b (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.11 [id=dc4abd9883284330944f38726b545e22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:28.748704 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 484e0d56f8274b218ea7db0586e7729b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:28.754079 25269 tablet_bootstrap.cc:492] T 484e0d56f8274b218ea7db0586e7729b P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:28.755772 25269 tablet_bootstrap.cc:654] T 484e0d56f8274b218ea7db0586e7729b P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:28.757943 25269 tablet_bootstrap.cc:492] T 484e0d56f8274b218ea7db0586e7729b P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:28.758136 25269 ts_tablet_manager.cc:1397] T 484e0d56f8274b218ea7db0586e7729b P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260807 18:14:28.758747 25269 raft_consensus.cc:348] T 484e0d56f8274b218ea7db0586e7729b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.758998 25269 raft_consensus.cc:374] T 484e0d56f8274b218ea7db0586e7729b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:28.759114 25269 raft_consensus.cc:729] T 484e0d56f8274b218ea7db0586e7729b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:28.759402 25269 consensus_queue.cc:260] T 484e0d56f8274b218ea7db0586e7729b P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.759616 25269 raft_consensus.cc:388] T 484e0d56f8274b218ea7db0586e7729b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:28.759727 25269 raft_consensus.cc:482] T 484e0d56f8274b218ea7db0586e7729b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:28.759828 25269 raft_consensus.cc:3037] T 484e0d56f8274b218ea7db0586e7729b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:28.761752 25269 raft_consensus.cc:504] T 484e0d56f8274b218ea7db0586e7729b P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.761947 25269 leader_election.cc:302] T 484e0d56f8274b218ea7db0586e7729b P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:28.762152 25269 leader_election.cc:288] T 484e0d56f8274b218ea7db0586e7729b P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:28.762215 25277 raft_consensus.cc:2781] T 484e0d56f8274b218ea7db0586e7729b P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:28.762418 25277 raft_consensus.cc:686] T 484e0d56f8274b218ea7db0586e7729b P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:28.762709 25277 consensus_queue.cc:237] T 484e0d56f8274b218ea7db0586e7729b P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.763031 25269 ts_tablet_manager.cc:1428] T 484e0d56f8274b218ea7db0586e7729b P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 18:14:28.766834 24957 catalog_manager.cc:5495] T 484e0d56f8274b218ea7db0586e7729b P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:28.790571 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000076
I20260807 18:14:28.802728 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49296:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.12"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:28.803542 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.013s user 0.010s sys 0.000s Metrics: {"bytes_written":6494,"cfile_init":1,"dirs.queue_time_us":61,"dirs.run_cpu_time_us":241,"dirs.run_wall_time_us":1513,"drs_written":1,"lbm_read_time_us":96,"lbm_reads_lt_1ms":4,"lbm_write_time_us":905,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":8}
I20260807 18:14:28.804340 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.445721
I20260807 18:14:28.815225 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 8dfa0fa27fa3492981fc579f1cc2ae4f (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.12 [id=b05501696ee44bc691f5aed0844ccf8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:28.815690 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dfa0fa27fa3492981fc579f1cc2ae4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:28.821097 25269 tablet_bootstrap.cc:492] T 8dfa0fa27fa3492981fc579f1cc2ae4f P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:28.822521 25269 tablet_bootstrap.cc:654] T 8dfa0fa27fa3492981fc579f1cc2ae4f P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:28.825450 25269 tablet_bootstrap.cc:492] T 8dfa0fa27fa3492981fc579f1cc2ae4f P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:28.825606 25269 ts_tablet_manager.cc:1397] T 8dfa0fa27fa3492981fc579f1cc2ae4f P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 18:14:28.826387 25269 raft_consensus.cc:348] T 8dfa0fa27fa3492981fc579f1cc2ae4f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.826594 25269 raft_consensus.cc:374] T 8dfa0fa27fa3492981fc579f1cc2ae4f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:28.826303 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.022s user 0.016s sys 0.003s Metrics: {"bytes_written":10914,"cfile_cache_hit":12,"cfile_cache_hit_bytes":5585,"cfile_cache_miss":28,"cfile_cache_miss_bytes":8609,"cfile_init":8,"delta_iterators_relevant":4,"dirs.queue_time_us":740,"dirs.run_cpu_time_us":259,"dirs.run_wall_time_us":1454,"drs_written":1,"lbm_read_time_us":1150,"lbm_reads_lt_1ms":60,"lbm_write_time_us":984,"lbm_writes_lt_1ms":27,"mutex_wait_us":23,"num_input_rowsets":2,"peak_mem_usage":2034,"rows_written":25,"spinlock_wait_cycles":896}
I20260807 18:14:28.826718 25269 raft_consensus.cc:729] T 8dfa0fa27fa3492981fc579f1cc2ae4f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:28.827078 25269 consensus_queue.cc:260] T 8dfa0fa27fa3492981fc579f1cc2ae4f P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.827232 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 1223 bytes on disk
I20260807 18:14:28.827343 25269 raft_consensus.cc:388] T 8dfa0fa27fa3492981fc579f1cc2ae4f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:28.827437 25269 raft_consensus.cc:482] T 8dfa0fa27fa3492981fc579f1cc2ae4f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:28.827553 25269 raft_consensus.cc:3037] T 8dfa0fa27fa3492981fc579f1cc2ae4f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:28.827891 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":85,"lbm_reads_lt_1ms":4}
I20260807 18:14:28.828534 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000007
I20260807 18:14:28.829828 25269 raft_consensus.cc:504] T 8dfa0fa27fa3492981fc579f1cc2ae4f P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.830109 25269 leader_election.cc:302] T 8dfa0fa27fa3492981fc579f1cc2ae4f P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:28.830327 25269 leader_election.cc:288] T 8dfa0fa27fa3492981fc579f1cc2ae4f P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:28.830447 25277 raft_consensus.cc:2781] T 8dfa0fa27fa3492981fc579f1cc2ae4f P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:28.830662 25277 raft_consensus.cc:686] T 8dfa0fa27fa3492981fc579f1cc2ae4f P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:28.830808 25269 ts_tablet_manager.cc:1428] T 8dfa0fa27fa3492981fc579f1cc2ae4f P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 18:14:28.830928 25277 consensus_queue.cc:237] T 8dfa0fa27fa3492981fc579f1cc2ae4f P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.835664 24957 catalog_manager.cc:5495] T 8dfa0fa27fa3492981fc579f1cc2ae4f P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:28.839340 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.011s user 0.007s sys 0.001s Metrics: {"bytes_written":5157,"cfile_init":1,"dirs.queue_time_us":63,"dirs.run_cpu_time_us":183,"dirs.run_wall_time_us":1595,"drs_written":1,"lbm_read_time_us":54,"lbm_reads_lt_1ms":4,"lbm_write_time_us":765,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2,"spinlock_wait_cycles":4992}
I20260807 18:14:28.840380 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.246021
I20260807 18:14:28.862967 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.022s user 0.014s sys 0.007s Metrics: {"bytes_written":336,"cfile_cache_hit":12,"cfile_cache_hit_bytes":5928,"cfile_cache_miss":28,"cfile_cache_miss_bytes":8910,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":716,"dirs.run_cpu_time_us":891,"dirs.run_wall_time_us":4798,"drs_written":1,"lbm_read_time_us":1114,"lbm_reads_lt_1ms":60,"lbm_write_time_us":1046,"lbm_writes_lt_1ms":31,"num_input_rowsets":2,"peak_mem_usage":3050,"reinsert_count":0,"rows_written":27,"update_count":1}
I20260807 18:14:28.864073 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 1295 bytes on disk
I20260807 18:14:28.864671 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":101,"lbm_reads_lt_1ms":4}
I20260807 18:14:28.872875 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49300:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.13"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:28.884011 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 5d41d4b7d9824027bd8dc3fbfd47de3f (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.13 [id=e79c0cb540e442c1811f16d439dfa7f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:28.884593 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d41d4b7d9824027bd8dc3fbfd47de3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:28.890038 25269 tablet_bootstrap.cc:492] T 5d41d4b7d9824027bd8dc3fbfd47de3f P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:28.891477 25269 tablet_bootstrap.cc:654] T 5d41d4b7d9824027bd8dc3fbfd47de3f P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:28.893868 25269 tablet_bootstrap.cc:492] T 5d41d4b7d9824027bd8dc3fbfd47de3f P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:28.894076 25269 ts_tablet_manager.cc:1397] T 5d41d4b7d9824027bd8dc3fbfd47de3f P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260807 18:14:28.894724 25269 raft_consensus.cc:348] T 5d41d4b7d9824027bd8dc3fbfd47de3f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.894956 25269 raft_consensus.cc:374] T 5d41d4b7d9824027bd8dc3fbfd47de3f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:28.895043 25269 raft_consensus.cc:729] T 5d41d4b7d9824027bd8dc3fbfd47de3f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:28.895311 25269 consensus_queue.cc:260] T 5d41d4b7d9824027bd8dc3fbfd47de3f P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.895491 25269 raft_consensus.cc:388] T 5d41d4b7d9824027bd8dc3fbfd47de3f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:28.895617 25269 raft_consensus.cc:482] T 5d41d4b7d9824027bd8dc3fbfd47de3f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:28.895725 25269 raft_consensus.cc:3037] T 5d41d4b7d9824027bd8dc3fbfd47de3f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:28.897789 25269 raft_consensus.cc:504] T 5d41d4b7d9824027bd8dc3fbfd47de3f P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.898042 25269 leader_election.cc:302] T 5d41d4b7d9824027bd8dc3fbfd47de3f P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:28.898254 25269 leader_election.cc:288] T 5d41d4b7d9824027bd8dc3fbfd47de3f P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:28.898382 25277 raft_consensus.cc:2781] T 5d41d4b7d9824027bd8dc3fbfd47de3f P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:28.898623 25277 raft_consensus.cc:686] T 5d41d4b7d9824027bd8dc3fbfd47de3f P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:28.898787 25269 ts_tablet_manager.cc:1428] T 5d41d4b7d9824027bd8dc3fbfd47de3f P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.003s sys 0.002s
I20260807 18:14:28.898890 25277 consensus_queue.cc:237] T 5d41d4b7d9824027bd8dc3fbfd47de3f P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.902115 24957 catalog_manager.cc:5495] T 5d41d4b7d9824027bd8dc3fbfd47de3f P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:28.930486 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49304:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.14"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:28.945322 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 4d0218fa5fab47e385ebe9377056ac66 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.14 [id=12402574b4c24094bab324c6e86574a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:28.945927 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d0218fa5fab47e385ebe9377056ac66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:28.951444 25269 tablet_bootstrap.cc:492] T 4d0218fa5fab47e385ebe9377056ac66 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:28.953153 25269 tablet_bootstrap.cc:654] T 4d0218fa5fab47e385ebe9377056ac66 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:28.959043 25269 tablet_bootstrap.cc:492] T 4d0218fa5fab47e385ebe9377056ac66 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:28.959197 25269 ts_tablet_manager.cc:1397] T 4d0218fa5fab47e385ebe9377056ac66 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260807 18:14:28.959982 25269 raft_consensus.cc:348] T 4d0218fa5fab47e385ebe9377056ac66 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.960183 25269 raft_consensus.cc:374] T 4d0218fa5fab47e385ebe9377056ac66 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:28.960287 25269 raft_consensus.cc:729] T 4d0218fa5fab47e385ebe9377056ac66 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:28.960512 25269 consensus_queue.cc:260] T 4d0218fa5fab47e385ebe9377056ac66 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.960709 25269 raft_consensus.cc:388] T 4d0218fa5fab47e385ebe9377056ac66 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:28.960783 25269 raft_consensus.cc:482] T 4d0218fa5fab47e385ebe9377056ac66 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:28.960883 25269 raft_consensus.cc:3037] T 4d0218fa5fab47e385ebe9377056ac66 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:28.963696 25269 raft_consensus.cc:504] T 4d0218fa5fab47e385ebe9377056ac66 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.963989 25269 leader_election.cc:302] T 4d0218fa5fab47e385ebe9377056ac66 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:28.964198 25269 leader_election.cc:288] T 4d0218fa5fab47e385ebe9377056ac66 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:28.964322 25277 raft_consensus.cc:2781] T 4d0218fa5fab47e385ebe9377056ac66 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:28.964519 25277 raft_consensus.cc:686] T 4d0218fa5fab47e385ebe9377056ac66 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:28.964644 25269 ts_tablet_manager.cc:1428] T 4d0218fa5fab47e385ebe9377056ac66 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260807 18:14:28.964733 25277 consensus_queue.cc:237] T 4d0218fa5fab47e385ebe9377056ac66 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:28.968055 24957 catalog_manager.cc:5495] T 4d0218fa5fab47e385ebe9377056ac66 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:28.973235 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000077
I20260807 18:14:28.989677 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.016s user 0.012s sys 0.000s Metrics: {"bytes_written":6495,"cfile_init":1,"dirs.queue_time_us":60,"dirs.run_cpu_time_us":175,"dirs.run_wall_time_us":1160,"drs_written":1,"lbm_read_time_us":103,"lbm_reads_lt_1ms":4,"lbm_write_time_us":903,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":8}
I20260807 18:14:28.990607 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 597 bytes on disk
I20260807 18:14:28.991417 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":132,"lbm_reads_lt_1ms":4}
I20260807 18:14:28.992311 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.386041
I20260807 18:14:29.022603 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.030s user 0.025s sys 0.004s Metrics: {"bytes_written":12217,"cfile_cache_hit":13,"cfile_cache_hit_bytes":6684,"cfile_cache_miss":31,"cfile_cache_miss_bytes":10562,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":715,"dirs.run_cpu_time_us":599,"dirs.run_wall_time_us":3267,"drs_written":1,"lbm_read_time_us":1805,"lbm_reads_lt_1ms":63,"lbm_write_time_us":1338,"lbm_writes_lt_1ms":27,"mutex_wait_us":121,"num_input_rowsets":2,"peak_mem_usage":2849,"rows_written":31}
I20260807 18:14:29.023679 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 1473 bytes on disk
I20260807 18:14:29.024325 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":108,"lbm_reads_lt_1ms":4}
I20260807 18:14:29.031311 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49306:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:29.042568 25147 tablet_service.cc:1467] Processing CreateTablet for tablet f04bdbb774134124a12161ab265256c7 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.15 [id=839eb40e4db7481d803f8a8bc5c926a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:29.042959 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f04bdbb774134124a12161ab265256c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:29.047987 25269 tablet_bootstrap.cc:492] T f04bdbb774134124a12161ab265256c7 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:29.049475 25269 tablet_bootstrap.cc:654] T f04bdbb774134124a12161ab265256c7 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:29.052012 25269 tablet_bootstrap.cc:492] T f04bdbb774134124a12161ab265256c7 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:29.052140 25269 ts_tablet_manager.cc:1397] T f04bdbb774134124a12161ab265256c7 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260807 18:14:29.052671 25269 raft_consensus.cc:348] T f04bdbb774134124a12161ab265256c7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.052834 25269 raft_consensus.cc:374] T f04bdbb774134124a12161ab265256c7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:29.052891 25269 raft_consensus.cc:729] T f04bdbb774134124a12161ab265256c7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:29.053087 25269 consensus_queue.cc:260] T f04bdbb774134124a12161ab265256c7 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.053216 25269 raft_consensus.cc:388] T f04bdbb774134124a12161ab265256c7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:29.053283 25269 raft_consensus.cc:482] T f04bdbb774134124a12161ab265256c7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:29.053399 25269 raft_consensus.cc:3037] T f04bdbb774134124a12161ab265256c7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:29.055518 25269 raft_consensus.cc:504] T f04bdbb774134124a12161ab265256c7 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.055708 25269 leader_election.cc:302] T f04bdbb774134124a12161ab265256c7 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:29.055972 25269 leader_election.cc:288] T f04bdbb774134124a12161ab265256c7 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:29.056031 25277 raft_consensus.cc:2781] T f04bdbb774134124a12161ab265256c7 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:29.056262 25277 raft_consensus.cc:686] T f04bdbb774134124a12161ab265256c7 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:29.056520 25277 consensus_queue.cc:237] T f04bdbb774134124a12161ab265256c7 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.056852 25269 ts_tablet_manager.cc:1428] T f04bdbb774134124a12161ab265256c7 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.000s sys 0.005s
I20260807 18:14:29.059958 24957 catalog_manager.cc:5495] T f04bdbb774134124a12161ab265256c7 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:29.092813 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49320:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:29.104770 25147 tablet_service.cc:1467] Processing CreateTablet for tablet bfb0504b57e948309859f9917edfecd3 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.16 [id=69a62d7d8dc543e3ac902d6b38b0727c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:29.105250 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfb0504b57e948309859f9917edfecd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:29.110016 25269 tablet_bootstrap.cc:492] T bfb0504b57e948309859f9917edfecd3 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:29.111385 25269 tablet_bootstrap.cc:654] T bfb0504b57e948309859f9917edfecd3 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:29.113848 25269 tablet_bootstrap.cc:492] T bfb0504b57e948309859f9917edfecd3 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:29.114003 25269 ts_tablet_manager.cc:1397] T bfb0504b57e948309859f9917edfecd3 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260807 18:14:29.114694 25269 raft_consensus.cc:348] T bfb0504b57e948309859f9917edfecd3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.114842 25269 raft_consensus.cc:374] T bfb0504b57e948309859f9917edfecd3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:29.114965 25269 raft_consensus.cc:729] T bfb0504b57e948309859f9917edfecd3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:29.115190 25269 consensus_queue.cc:260] T bfb0504b57e948309859f9917edfecd3 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.115363 25269 raft_consensus.cc:388] T bfb0504b57e948309859f9917edfecd3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:29.115449 25269 raft_consensus.cc:482] T bfb0504b57e948309859f9917edfecd3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:29.115579 25269 raft_consensus.cc:3037] T bfb0504b57e948309859f9917edfecd3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:29.115701 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000077
I20260807 18:14:29.117911 25269 raft_consensus.cc:504] T bfb0504b57e948309859f9917edfecd3 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.118182 25269 leader_election.cc:302] T bfb0504b57e948309859f9917edfecd3 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:29.118379 25269 leader_election.cc:288] T bfb0504b57e948309859f9917edfecd3 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:29.118455 25277 raft_consensus.cc:2781] T bfb0504b57e948309859f9917edfecd3 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:29.118628 25277 raft_consensus.cc:686] T bfb0504b57e948309859f9917edfecd3 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:29.118831 25277 consensus_queue.cc:237] T bfb0504b57e948309859f9917edfecd3 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.119520 25269 ts_tablet_manager.cc:1428] T bfb0504b57e948309859f9917edfecd3 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 18:14:29.122186 24956 catalog_manager.cc:5495] T bfb0504b57e948309859f9917edfecd3 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:29.130239 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.014s user 0.004s sys 0.007s Metrics: {"bytes_written":6459,"cfile_init":1,"dirs.queue_time_us":65,"dirs.run_cpu_time_us":188,"dirs.run_wall_time_us":1454,"drs_written":1,"lbm_read_time_us":92,"lbm_reads_lt_1ms":4,"lbm_write_time_us":881,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":8}
I20260807 18:14:29.131074 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 589 bytes on disk
I20260807 18:14:29.131582 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":59,"lbm_reads_lt_1ms":4}
I20260807 18:14:29.132164 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.386918
I20260807 18:14:29.152791 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.020s user 0.016s sys 0.004s Metrics: {"bytes_written":336,"cfile_cache_hit":13,"cfile_cache_hit_bytes":7385,"cfile_cache_miss":31,"cfile_cache_miss_bytes":11617,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":6,"dirs.queue_time_us":158,"dirs.run_cpu_time_us":189,"dirs.run_wall_time_us":1452,"drs_written":1,"lbm_read_time_us":1175,"lbm_reads_lt_1ms":63,"lbm_write_time_us":883,"lbm_writes_lt_1ms":31,"mutex_wait_us":26,"num_input_rowsets":2,"peak_mem_usage":3357,"reinsert_count":0,"rows_written":35,"spinlock_wait_cycles":768,"update_count":1}
I20260807 18:14:29.154191 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 1641 bytes on disk
I20260807 18:14:29.154912 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":72,"lbm_reads_lt_1ms":4}
I20260807 18:14:29.169055 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49330:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.17"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:29.180760 25147 tablet_service.cc:1467] Processing CreateTablet for tablet abbe8f73efad45ffa7b04bf12e6d7eb7 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.17 [id=0e079ef44dc048f985f1fa9e53195bd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:29.181322 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abbe8f73efad45ffa7b04bf12e6d7eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:29.186766 25269 tablet_bootstrap.cc:492] T abbe8f73efad45ffa7b04bf12e6d7eb7 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:29.188189 25269 tablet_bootstrap.cc:654] T abbe8f73efad45ffa7b04bf12e6d7eb7 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:29.213928 25269 tablet_bootstrap.cc:492] T abbe8f73efad45ffa7b04bf12e6d7eb7 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:29.214128 25269 ts_tablet_manager.cc:1397] T abbe8f73efad45ffa7b04bf12e6d7eb7 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.000s
I20260807 18:14:29.214802 25269 raft_consensus.cc:348] T abbe8f73efad45ffa7b04bf12e6d7eb7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.215058 25269 raft_consensus.cc:374] T abbe8f73efad45ffa7b04bf12e6d7eb7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:29.215144 25269 raft_consensus.cc:729] T abbe8f73efad45ffa7b04bf12e6d7eb7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:29.215381 25269 consensus_queue.cc:260] T abbe8f73efad45ffa7b04bf12e6d7eb7 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.215549 25269 raft_consensus.cc:388] T abbe8f73efad45ffa7b04bf12e6d7eb7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:29.215616 25269 raft_consensus.cc:482] T abbe8f73efad45ffa7b04bf12e6d7eb7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:29.215684 25269 raft_consensus.cc:3037] T abbe8f73efad45ffa7b04bf12e6d7eb7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:29.217707 25269 raft_consensus.cc:504] T abbe8f73efad45ffa7b04bf12e6d7eb7 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.217900 25269 leader_election.cc:302] T abbe8f73efad45ffa7b04bf12e6d7eb7 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:29.218102 25269 leader_election.cc:288] T abbe8f73efad45ffa7b04bf12e6d7eb7 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:29.218181 25277 raft_consensus.cc:2781] T abbe8f73efad45ffa7b04bf12e6d7eb7 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:29.218324 25277 raft_consensus.cc:686] T abbe8f73efad45ffa7b04bf12e6d7eb7 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:29.218569 25277 consensus_queue.cc:237] T abbe8f73efad45ffa7b04bf12e6d7eb7 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.218933 25269 ts_tablet_manager.cc:1428] T abbe8f73efad45ffa7b04bf12e6d7eb7 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 18:14:29.221987 24956 catalog_manager.cc:5495] T abbe8f73efad45ffa7b04bf12e6d7eb7 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:29.253615 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49340:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.18"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:29.265236 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 68b6b2a0e18d45bb8eeaf820a90471c0 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.18 [id=ac824032871b4570a012ad912931a487]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:29.265812 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68b6b2a0e18d45bb8eeaf820a90471c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:29.270586 25269 tablet_bootstrap.cc:492] T 68b6b2a0e18d45bb8eeaf820a90471c0 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:29.271942 25269 tablet_bootstrap.cc:654] T 68b6b2a0e18d45bb8eeaf820a90471c0 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:29.274118 25269 tablet_bootstrap.cc:492] T 68b6b2a0e18d45bb8eeaf820a90471c0 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:29.274298 25269 ts_tablet_manager.cc:1397] T 68b6b2a0e18d45bb8eeaf820a90471c0 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260807 18:14:29.274919 25269 raft_consensus.cc:348] T 68b6b2a0e18d45bb8eeaf820a90471c0 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.275105 25269 raft_consensus.cc:374] T 68b6b2a0e18d45bb8eeaf820a90471c0 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:29.275233 25269 raft_consensus.cc:729] T 68b6b2a0e18d45bb8eeaf820a90471c0 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:29.275269 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000079
I20260807 18:14:29.275561 25269 consensus_queue.cc:260] T 68b6b2a0e18d45bb8eeaf820a90471c0 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.275772 25269 raft_consensus.cc:388] T 68b6b2a0e18d45bb8eeaf820a90471c0 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:29.275866 25269 raft_consensus.cc:482] T 68b6b2a0e18d45bb8eeaf820a90471c0 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:29.276008 25269 raft_consensus.cc:3037] T 68b6b2a0e18d45bb8eeaf820a90471c0 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:29.278287 25269 raft_consensus.cc:504] T 68b6b2a0e18d45bb8eeaf820a90471c0 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.278558 25269 leader_election.cc:302] T 68b6b2a0e18d45bb8eeaf820a90471c0 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:29.278750 25269 leader_election.cc:288] T 68b6b2a0e18d45bb8eeaf820a90471c0 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:29.278815 25277 raft_consensus.cc:2781] T 68b6b2a0e18d45bb8eeaf820a90471c0 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:29.279009 25277 raft_consensus.cc:686] T 68b6b2a0e18d45bb8eeaf820a90471c0 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:29.279279 25269 ts_tablet_manager.cc:1428] T 68b6b2a0e18d45bb8eeaf820a90471c0 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.000s sys 0.004s
I20260807 18:14:29.279253 25277 consensus_queue.cc:237] T 68b6b2a0e18d45bb8eeaf820a90471c0 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.283070 24956 catalog_manager.cc:5495] T 68b6b2a0e18d45bb8eeaf820a90471c0 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:29.287628 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.011s sys 0.000s Metrics: {"bytes_written":6459,"cfile_init":1,"dirs.queue_time_us":69,"dirs.run_cpu_time_us":202,"dirs.run_wall_time_us":1548,"drs_written":1,"lbm_read_time_us":89,"lbm_reads_lt_1ms":4,"lbm_write_time_us":852,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":8}
I20260807 18:14:29.288427 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.378372
I20260807 18:14:29.310860 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.022s user 0.014s sys 0.007s Metrics: {"bytes_written":13985,"cfile_cache_hit":12,"cfile_cache_hit_bytes":8126,"cfile_cache_miss":28,"cfile_cache_miss_bytes":12360,"cfile_init":8,"delta_iterators_relevant":4,"dirs.queue_time_us":1082,"dirs.run_cpu_time_us":692,"dirs.run_wall_time_us":3326,"drs_written":1,"lbm_read_time_us":1178,"lbm_reads_lt_1ms":60,"lbm_write_time_us":784,"lbm_writes_lt_1ms":27,"mutex_wait_us":408,"num_input_rowsets":2,"peak_mem_usage":3812,"rows_written":39}
I20260807 18:14:29.311908 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 1820 bytes on disk
I20260807 18:14:29.312644 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":104,"lbm_reads_lt_1ms":4}
I20260807 18:14:29.315886 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49354:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:29.327968 25147 tablet_service.cc:1467] Processing CreateTablet for tablet bb912970a72d49e3a4b119daa31add77 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.19 [id=21e3d00e97d143c581d39b92c619bf8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:29.328429 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb912970a72d49e3a4b119daa31add77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:29.332734 25269 tablet_bootstrap.cc:492] T bb912970a72d49e3a4b119daa31add77 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:29.334218 25269 tablet_bootstrap.cc:654] T bb912970a72d49e3a4b119daa31add77 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:29.336508 25269 tablet_bootstrap.cc:492] T bb912970a72d49e3a4b119daa31add77 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:29.336656 25269 ts_tablet_manager.cc:1397] T bb912970a72d49e3a4b119daa31add77 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260807 18:14:29.337262 25269 raft_consensus.cc:348] T bb912970a72d49e3a4b119daa31add77 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.337512 25269 raft_consensus.cc:374] T bb912970a72d49e3a4b119daa31add77 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:29.337584 25269 raft_consensus.cc:729] T bb912970a72d49e3a4b119daa31add77 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:29.337812 25269 consensus_queue.cc:260] T bb912970a72d49e3a4b119daa31add77 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.337950 25269 raft_consensus.cc:388] T bb912970a72d49e3a4b119daa31add77 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:29.338025 25269 raft_consensus.cc:482] T bb912970a72d49e3a4b119daa31add77 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:29.338100 25269 raft_consensus.cc:3037] T bb912970a72d49e3a4b119daa31add77 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:29.340224 25269 raft_consensus.cc:504] T bb912970a72d49e3a4b119daa31add77 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.340433 25269 leader_election.cc:302] T bb912970a72d49e3a4b119daa31add77 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:29.340658 25269 leader_election.cc:288] T bb912970a72d49e3a4b119daa31add77 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:29.340729 25277 raft_consensus.cc:2781] T bb912970a72d49e3a4b119daa31add77 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:29.340865 25277 raft_consensus.cc:686] T bb912970a72d49e3a4b119daa31add77 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:29.341100 25277 consensus_queue.cc:237] T bb912970a72d49e3a4b119daa31add77 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.341485 25269 ts_tablet_manager.cc:1428] T bb912970a72d49e3a4b119daa31add77 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 18:14:29.346684 24956 catalog_manager.cc:5495] T bb912970a72d49e3a4b119daa31add77 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:29.381616 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49360:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:29.392680 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 643c409a05694a249501f170180a29ed (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.20 [id=d93467f6775f4a1e8076ad7ff3788e22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:29.393177 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 643c409a05694a249501f170180a29ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:29.398281 25269 tablet_bootstrap.cc:492] T 643c409a05694a249501f170180a29ed P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:29.399664 25269 tablet_bootstrap.cc:654] T 643c409a05694a249501f170180a29ed P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:29.401960 25269 tablet_bootstrap.cc:492] T 643c409a05694a249501f170180a29ed P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:29.402124 25269 ts_tablet_manager.cc:1397] T 643c409a05694a249501f170180a29ed P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260807 18:14:29.402788 25269 raft_consensus.cc:348] T 643c409a05694a249501f170180a29ed P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.402961 25269 raft_consensus.cc:374] T 643c409a05694a249501f170180a29ed P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:29.403070 25269 raft_consensus.cc:729] T 643c409a05694a249501f170180a29ed P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:29.403334 25269 consensus_queue.cc:260] T 643c409a05694a249501f170180a29ed P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.403530 25269 raft_consensus.cc:388] T 643c409a05694a249501f170180a29ed P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:29.403611 25269 raft_consensus.cc:482] T 643c409a05694a249501f170180a29ed P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:29.403764 25269 raft_consensus.cc:3037] T 643c409a05694a249501f170180a29ed P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:29.405841 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000077
I20260807 18:14:29.405906 25269 raft_consensus.cc:504] T 643c409a05694a249501f170180a29ed P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.406229 25269 leader_election.cc:302] T 643c409a05694a249501f170180a29ed P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:29.406425 25269 leader_election.cc:288] T 643c409a05694a249501f170180a29ed P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:29.406548 25275 raft_consensus.cc:2781] T 643c409a05694a249501f170180a29ed P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:29.406731 25275 raft_consensus.cc:686] T 643c409a05694a249501f170180a29ed P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:29.406956 25269 ts_tablet_manager.cc:1428] T 643c409a05694a249501f170180a29ed P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 18:14:29.406996 25275 consensus_queue.cc:237] T 643c409a05694a249501f170180a29ed P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.413161 24956 catalog_manager.cc:5495] T 643c409a05694a249501f170180a29ed P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:29.420600 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.014s user 0.011s sys 0.000s Metrics: {"bytes_written":6458,"cfile_init":1,"dirs.queue_time_us":83,"dirs.run_cpu_time_us":228,"dirs.run_wall_time_us":1188,"drs_written":1,"lbm_read_time_us":70,"lbm_reads_lt_1ms":4,"lbm_write_time_us":953,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":8}
I20260807 18:14:29.421624 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.357675
I20260807 18:14:29.444387 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.022s user 0.017s sys 0.004s Metrics: {"bytes_written":14858,"cfile_cache_hit":13,"cfile_cache_hit_bytes":8895,"cfile_cache_miss":31,"cfile_cache_miss_bytes":13857,"cfile_init":9,"delta_iterators_relevant":6,"dirs.queue_time_us":695,"dirs.run_cpu_time_us":260,"dirs.run_wall_time_us":1228,"drs_written":1,"lbm_read_time_us":1128,"lbm_reads_lt_1ms":67,"lbm_write_time_us":728,"lbm_writes_lt_1ms":27,"mutex_wait_us":120,"num_input_rowsets":2,"peak_mem_usage":4543,"rows_written":43,"spinlock_wait_cycles":11904}
I20260807 18:14:29.445518 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 1976 bytes on disk
I20260807 18:14:29.446184 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":72,"lbm_reads_lt_1ms":4}
I20260807 18:14:29.446557 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49364:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:29.458438 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 1f73a7e832ad473991f0966d4b5894fd (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.21 [id=1fab4bee5b704ceba1fd430e5417fb68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:29.458957 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f73a7e832ad473991f0966d4b5894fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:29.463578 25269 tablet_bootstrap.cc:492] T 1f73a7e832ad473991f0966d4b5894fd P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:29.464895 25269 tablet_bootstrap.cc:654] T 1f73a7e832ad473991f0966d4b5894fd P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:29.467279 25269 tablet_bootstrap.cc:492] T 1f73a7e832ad473991f0966d4b5894fd P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:29.467414 25269 ts_tablet_manager.cc:1397] T 1f73a7e832ad473991f0966d4b5894fd P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260807 18:14:29.468034 25269 raft_consensus.cc:348] T 1f73a7e832ad473991f0966d4b5894fd P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.468205 25269 raft_consensus.cc:374] T 1f73a7e832ad473991f0966d4b5894fd P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:29.468262 25269 raft_consensus.cc:729] T 1f73a7e832ad473991f0966d4b5894fd P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:29.468452 25269 consensus_queue.cc:260] T 1f73a7e832ad473991f0966d4b5894fd P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.468605 25269 raft_consensus.cc:388] T 1f73a7e832ad473991f0966d4b5894fd P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:29.468676 25269 raft_consensus.cc:482] T 1f73a7e832ad473991f0966d4b5894fd P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:29.468744 25269 raft_consensus.cc:3037] T 1f73a7e832ad473991f0966d4b5894fd P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:29.470889 25269 raft_consensus.cc:504] T 1f73a7e832ad473991f0966d4b5894fd P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.471086 25269 leader_election.cc:302] T 1f73a7e832ad473991f0966d4b5894fd P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:29.471258 25269 leader_election.cc:288] T 1f73a7e832ad473991f0966d4b5894fd P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:29.471336 25275 raft_consensus.cc:2781] T 1f73a7e832ad473991f0966d4b5894fd P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:29.471619 25275 raft_consensus.cc:686] T 1f73a7e832ad473991f0966d4b5894fd P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:29.471750 25269 ts_tablet_manager.cc:1428] T 1f73a7e832ad473991f0966d4b5894fd P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260807 18:14:29.471836 25275 consensus_queue.cc:237] T 1f73a7e832ad473991f0966d4b5894fd P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.474586 24957 catalog_manager.cc:5495] T 1f73a7e832ad473991f0966d4b5894fd P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:29.505273 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49368:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:29.517465 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 311c7fde7db74803ab519d2a9572ee7b (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.22 [id=f5dc1c645d4d44d4bf1aa072eb655d29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:29.517925 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 311c7fde7db74803ab519d2a9572ee7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:29.522253 25269 tablet_bootstrap.cc:492] T 311c7fde7db74803ab519d2a9572ee7b P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:29.523713 25269 tablet_bootstrap.cc:654] T 311c7fde7db74803ab519d2a9572ee7b P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:29.526051 25269 tablet_bootstrap.cc:492] T 311c7fde7db74803ab519d2a9572ee7b P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:29.526211 25269 ts_tablet_manager.cc:1397] T 311c7fde7db74803ab519d2a9572ee7b P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260807 18:14:29.526825 25269 raft_consensus.cc:348] T 311c7fde7db74803ab519d2a9572ee7b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.527009 25269 raft_consensus.cc:374] T 311c7fde7db74803ab519d2a9572ee7b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:29.527143 25269 raft_consensus.cc:729] T 311c7fde7db74803ab519d2a9572ee7b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:29.527400 25269 consensus_queue.cc:260] T 311c7fde7db74803ab519d2a9572ee7b P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.527618 25269 raft_consensus.cc:388] T 311c7fde7db74803ab519d2a9572ee7b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:29.527691 25269 raft_consensus.cc:482] T 311c7fde7db74803ab519d2a9572ee7b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:29.527770 25269 raft_consensus.cc:3037] T 311c7fde7db74803ab519d2a9572ee7b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:29.530292 25269 raft_consensus.cc:504] T 311c7fde7db74803ab519d2a9572ee7b P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.530560 25269 leader_election.cc:302] T 311c7fde7db74803ab519d2a9572ee7b P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:29.530738 25269 leader_election.cc:288] T 311c7fde7db74803ab519d2a9572ee7b P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:29.530913 25275 raft_consensus.cc:2781] T 311c7fde7db74803ab519d2a9572ee7b P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:29.531102 25275 raft_consensus.cc:686] T 311c7fde7db74803ab519d2a9572ee7b P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:29.531195 25269 ts_tablet_manager.cc:1428] T 311c7fde7db74803ab519d2a9572ee7b P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.000s sys 0.004s
I20260807 18:14:29.531342 25275 consensus_queue.cc:237] T 311c7fde7db74803ab519d2a9572ee7b P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.534739 24957 catalog_manager.cc:5495] T 311c7fde7db74803ab519d2a9572ee7b P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:29.563699 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000077
I20260807 18:14:29.567708 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49384:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.23"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:29.576355 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.009s sys 0.000s Metrics: {"bytes_written":6496,"cfile_init":1,"dirs.queue_time_us":65,"dirs.run_cpu_time_us":277,"dirs.run_wall_time_us":1234,"drs_written":1,"lbm_read_time_us":75,"lbm_reads_lt_1ms":4,"lbm_write_time_us":915,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":8}
I20260807 18:14:29.577979 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 602 bytes on disk
I20260807 18:14:29.578665 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":96,"lbm_reads_lt_1ms":4}
I20260807 18:14:29.579515 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.353600
I20260807 18:14:29.580535 25147 tablet_service.cc:1467] Processing CreateTablet for tablet be506d46eb494f209dd58ae71f00e3ae (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.23 [id=7f2d21c0563b4537995dac426cdf1657]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:29.581035 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be506d46eb494f209dd58ae71f00e3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:29.586191 25269 tablet_bootstrap.cc:492] T be506d46eb494f209dd58ae71f00e3ae P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:29.587718 25269 tablet_bootstrap.cc:654] T be506d46eb494f209dd58ae71f00e3ae P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:29.590379 25269 tablet_bootstrap.cc:492] T be506d46eb494f209dd58ae71f00e3ae P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:29.590613 25269 ts_tablet_manager.cc:1397] T be506d46eb494f209dd58ae71f00e3ae P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260807 18:14:29.591338 25269 raft_consensus.cc:348] T be506d46eb494f209dd58ae71f00e3ae P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.591567 25269 raft_consensus.cc:374] T be506d46eb494f209dd58ae71f00e3ae P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:29.591660 25269 raft_consensus.cc:729] T be506d46eb494f209dd58ae71f00e3ae P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:29.591946 25269 consensus_queue.cc:260] T be506d46eb494f209dd58ae71f00e3ae P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.592172 25269 raft_consensus.cc:388] T be506d46eb494f209dd58ae71f00e3ae P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:29.592307 25269 raft_consensus.cc:482] T be506d46eb494f209dd58ae71f00e3ae P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:29.592410 25269 raft_consensus.cc:3037] T be506d46eb494f209dd58ae71f00e3ae P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:29.594316 25269 raft_consensus.cc:504] T be506d46eb494f209dd58ae71f00e3ae P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.594556 25269 leader_election.cc:302] T be506d46eb494f209dd58ae71f00e3ae P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:29.594784 25269 leader_election.cc:288] T be506d46eb494f209dd58ae71f00e3ae P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:29.594871 25275 raft_consensus.cc:2781] T be506d46eb494f209dd58ae71f00e3ae P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:29.595065 25275 raft_consensus.cc:686] T be506d46eb494f209dd58ae71f00e3ae P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:29.595264 25269 ts_tablet_manager.cc:1428] T be506d46eb494f209dd58ae71f00e3ae P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 18:14:29.595317 25275 consensus_queue.cc:237] T be506d46eb494f209dd58ae71f00e3ae P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.599104 24957 catalog_manager.cc:5495] T be506d46eb494f209dd58ae71f00e3ae P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:29.602363 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.023s user 0.021s sys 0.000s Metrics: {"bytes_written":15729,"cfile_cache_hit":12,"cfile_cache_hit_bytes":9639,"cfile_cache_miss":28,"cfile_cache_miss_bytes":14585,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":1234,"dirs.run_cpu_time_us":656,"dirs.run_wall_time_us":4357,"drs_written":1,"lbm_read_time_us":917,"lbm_reads_lt_1ms":56,"lbm_write_time_us":974,"lbm_writes_lt_1ms":27,"mutex_wait_us":64,"num_input_rowsets":2,"peak_mem_usage":5037,"rows_written":47,"spinlock_wait_cycles":8320,"thread_start_us":814,"threads_started":2}
I20260807 18:14:29.603643 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 2138 bytes on disk
I20260807 18:14:29.604377 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":113,"lbm_reads_lt_1ms":4}
I20260807 18:14:29.605080 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000008
I20260807 18:14:29.615607 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.010s user 0.005s sys 0.003s Metrics: {"bytes_written":5194,"cfile_init":1,"dirs.queue_time_us":281,"dirs.run_cpu_time_us":193,"dirs.run_wall_time_us":1217,"drs_written":1,"lbm_read_time_us":49,"lbm_reads_lt_1ms":4,"lbm_write_time_us":944,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:29.616637 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.261397
I20260807 18:14:29.637125 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49400:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:29.639271 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.022s user 0.018s sys 0.004s Metrics: {"bytes_written":16181,"cfile_cache_hit":12,"cfile_cache_hit_bytes":10020,"cfile_cache_miss":28,"cfile_cache_miss_bytes":15120,"cfile_init":8,"delta_iterators_relevant":4,"dirs.queue_time_us":673,"dirs.run_cpu_time_us":168,"dirs.run_wall_time_us":1292,"drs_written":1,"lbm_read_time_us":1100,"lbm_reads_lt_1ms":60,"lbm_write_time_us":995,"lbm_writes_lt_1ms":27,"mutex_wait_us":24,"num_input_rowsets":2,"peak_mem_usage":6053,"rows_written":49,"spinlock_wait_cycles":3968}
I20260807 18:14:29.640246 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 2224 bytes on disk
I20260807 18:14:29.640894 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":60,"lbm_reads_lt_1ms":4}
I20260807 18:14:29.650319 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 54c18c3499024f3690dc46d1b60165a4 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.24 [id=cb43a268d2064203aa177c9f5e5d3273]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:29.650825 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54c18c3499024f3690dc46d1b60165a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:29.655977 25269 tablet_bootstrap.cc:492] T 54c18c3499024f3690dc46d1b60165a4 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:29.657289 25269 tablet_bootstrap.cc:654] T 54c18c3499024f3690dc46d1b60165a4 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:29.659685 25269 tablet_bootstrap.cc:492] T 54c18c3499024f3690dc46d1b60165a4 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:29.659833 25269 ts_tablet_manager.cc:1397] T 54c18c3499024f3690dc46d1b60165a4 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260807 18:14:29.660462 25269 raft_consensus.cc:348] T 54c18c3499024f3690dc46d1b60165a4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.660617 25269 raft_consensus.cc:374] T 54c18c3499024f3690dc46d1b60165a4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:29.660739 25269 raft_consensus.cc:729] T 54c18c3499024f3690dc46d1b60165a4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:29.660995 25269 consensus_queue.cc:260] T 54c18c3499024f3690dc46d1b60165a4 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.661213 25269 raft_consensus.cc:388] T 54c18c3499024f3690dc46d1b60165a4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:29.661315 25269 raft_consensus.cc:482] T 54c18c3499024f3690dc46d1b60165a4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:29.661492 25269 raft_consensus.cc:3037] T 54c18c3499024f3690dc46d1b60165a4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:29.663679 25269 raft_consensus.cc:504] T 54c18c3499024f3690dc46d1b60165a4 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.663929 25269 leader_election.cc:302] T 54c18c3499024f3690dc46d1b60165a4 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:29.664141 25269 leader_election.cc:288] T 54c18c3499024f3690dc46d1b60165a4 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:29.664237 25275 raft_consensus.cc:2781] T 54c18c3499024f3690dc46d1b60165a4 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:29.664454 25275 raft_consensus.cc:686] T 54c18c3499024f3690dc46d1b60165a4 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:29.664776 25269 ts_tablet_manager.cc:1428] T 54c18c3499024f3690dc46d1b60165a4 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.004s sys 0.001s
I20260807 18:14:29.664739 25275 consensus_queue.cc:237] T 54c18c3499024f3690dc46d1b60165a4 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.668164 24956 catalog_manager.cc:5495] T 54c18c3499024f3690dc46d1b60165a4 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:29.697165 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000077
I20260807 18:14:29.697944 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49404:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:29.710517 25147 tablet_service.cc:1467] Processing CreateTablet for tablet b6f780633ff142f7a583dabbe37267e1 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.25 [id=7fa90eb51bf240219c84a053a700aafe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:29.710886 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6f780633ff142f7a583dabbe37267e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:29.713862 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.016s user 0.008s sys 0.003s Metrics: {"bytes_written":6496,"cfile_init":1,"dirs.queue_time_us":57,"dirs.run_cpu_time_us":236,"dirs.run_wall_time_us":1310,"drs_written":1,"lbm_read_time_us":73,"lbm_reads_lt_1ms":4,"lbm_write_time_us":844,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":8}
I20260807 18:14:29.714727 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 599 bytes on disk
I20260807 18:14:29.715410 25269 tablet_bootstrap.cc:492] T b6f780633ff142f7a583dabbe37267e1 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:29.715548 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":95,"lbm_reads_lt_1ms":4}
I20260807 18:14:29.716830 25269 tablet_bootstrap.cc:654] T b6f780633ff142f7a583dabbe37267e1 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:29.717811 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.343704
I20260807 18:14:29.720003 25269 tablet_bootstrap.cc:492] T b6f780633ff142f7a583dabbe37267e1 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:29.720180 25269 ts_tablet_manager.cc:1397] T b6f780633ff142f7a583dabbe37267e1 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260807 18:14:29.720799 25269 raft_consensus.cc:348] T b6f780633ff142f7a583dabbe37267e1 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.720965 25269 raft_consensus.cc:374] T b6f780633ff142f7a583dabbe37267e1 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:29.721069 25269 raft_consensus.cc:729] T b6f780633ff142f7a583dabbe37267e1 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:29.721391 25269 consensus_queue.cc:260] T b6f780633ff142f7a583dabbe37267e1 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.721557 25269 raft_consensus.cc:388] T b6f780633ff142f7a583dabbe37267e1 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:29.721669 25269 raft_consensus.cc:482] T b6f780633ff142f7a583dabbe37267e1 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:29.721753 25269 raft_consensus.cc:3037] T b6f780633ff142f7a583dabbe37267e1 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:29.723902 25269 raft_consensus.cc:504] T b6f780633ff142f7a583dabbe37267e1 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.724157 25269 leader_election.cc:302] T b6f780633ff142f7a583dabbe37267e1 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:29.724383 25269 leader_election.cc:288] T b6f780633ff142f7a583dabbe37267e1 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:29.724469 25275 raft_consensus.cc:2781] T b6f780633ff142f7a583dabbe37267e1 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:29.724663 25275 raft_consensus.cc:686] T b6f780633ff142f7a583dabbe37267e1 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:29.724890 25269 ts_tablet_manager.cc:1428] T b6f780633ff142f7a583dabbe37267e1 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.001s sys 0.004s
I20260807 18:14:29.724897 25275 consensus_queue.cc:237] T b6f780633ff142f7a583dabbe37267e1 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.729672 24956 catalog_manager.cc:5495] T b6f780633ff142f7a583dabbe37267e1 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:29.740209 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.022s user 0.013s sys 0.009s Metrics: {"bytes_written":16612,"cfile_cache_hit":12,"cfile_cache_hit_bytes":10377,"cfile_cache_miss":28,"cfile_cache_miss_bytes":15637,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":488,"dirs.run_cpu_time_us":610,"dirs.run_wall_time_us":3027,"drs_written":1,"lbm_read_time_us":1029,"lbm_reads_lt_1ms":56,"lbm_write_time_us":992,"lbm_writes_lt_1ms":27,"mutex_wait_us":24,"num_input_rowsets":2,"peak_mem_usage":5545,"rows_written":51,"spinlock_wait_cycles":4864}
I20260807 18:14:29.741115 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 2305 bytes on disk
I20260807 18:14:29.741710 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":70,"lbm_reads_lt_1ms":4}
I20260807 18:14:29.742242 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000008
I20260807 18:14:29.752624 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.010s user 0.005s sys 0.002s Metrics: {"bytes_written":5194,"cfile_init":1,"dirs.queue_time_us":56,"dirs.run_cpu_time_us":228,"dirs.run_wall_time_us":1245,"drs_written":1,"lbm_read_time_us":76,"lbm_reads_lt_1ms":4,"lbm_write_time_us":822,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:29.753389 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 358 bytes on disk
I20260807 18:14:29.754050 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":108,"lbm_reads_lt_1ms":4}
I20260807 18:14:29.754772 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.257474
I20260807 18:14:29.766094 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49406:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.26"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:29.778303 25147 tablet_service.cc:1467] Processing CreateTablet for tablet a9f18d3fda934873a6f4bb8328e14b92 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.26 [id=99792b622b5342d5bf77cc36bc9abcf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:29.778740 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9f18d3fda934873a6f4bb8328e14b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:29.778909 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.023s user 0.021s sys 0.000s Metrics: {"bytes_written":17051,"cfile_cache_hit":12,"cfile_cache_hit_bytes":10758,"cfile_cache_miss":28,"cfile_cache_miss_bytes":16212,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":852,"dirs.run_cpu_time_us":957,"dirs.run_wall_time_us":5228,"drs_written":1,"lbm_read_time_us":1017,"lbm_reads_lt_1ms":56,"lbm_write_time_us":826,"lbm_writes_lt_1ms":27,"mutex_wait_us":281,"num_input_rowsets":2,"peak_mem_usage":6563,"rows_written":53,"spinlock_wait_cycles":2688}
I20260807 18:14:29.779798 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 2385 bytes on disk
I20260807 18:14:29.780481 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":107,"lbm_reads_lt_1ms":4}
I20260807 18:14:29.781001 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000008
I20260807 18:14:29.784098 25269 tablet_bootstrap.cc:492] T a9f18d3fda934873a6f4bb8328e14b92 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:29.785746 25269 tablet_bootstrap.cc:654] T a9f18d3fda934873a6f4bb8328e14b92 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:29.788103 25269 tablet_bootstrap.cc:492] T a9f18d3fda934873a6f4bb8328e14b92 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:29.788249 25269 ts_tablet_manager.cc:1397] T a9f18d3fda934873a6f4bb8328e14b92 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260807 18:14:29.788908 25269 raft_consensus.cc:348] T a9f18d3fda934873a6f4bb8328e14b92 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.789068 25269 raft_consensus.cc:374] T a9f18d3fda934873a6f4bb8328e14b92 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:29.789181 25269 raft_consensus.cc:729] T a9f18d3fda934873a6f4bb8328e14b92 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:29.789449 25269 consensus_queue.cc:260] T a9f18d3fda934873a6f4bb8328e14b92 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.789695 25269 raft_consensus.cc:388] T a9f18d3fda934873a6f4bb8328e14b92 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:29.789781 25269 raft_consensus.cc:482] T a9f18d3fda934873a6f4bb8328e14b92 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:29.789924 25269 raft_consensus.cc:3037] T a9f18d3fda934873a6f4bb8328e14b92 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:29.791947 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.011s user 0.008s sys 0.000s Metrics: {"bytes_written":5157,"cfile_init":1,"dirs.queue_time_us":110,"dirs.run_cpu_time_us":224,"dirs.run_wall_time_us":1139,"drs_written":1,"lbm_read_time_us":110,"lbm_reads_lt_1ms":4,"lbm_write_time_us":723,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2,"spinlock_wait_cycles":27776}
I20260807 18:14:29.792246 25269 raft_consensus.cc:504] T a9f18d3fda934873a6f4bb8328e14b92 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.792531 25269 leader_election.cc:302] T a9f18d3fda934873a6f4bb8328e14b92 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:29.792726 25269 leader_election.cc:288] T a9f18d3fda934873a6f4bb8328e14b92 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:29.792812 25275 raft_consensus.cc:2781] T a9f18d3fda934873a6f4bb8328e14b92 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:29.792867 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.251683
I20260807 18:14:29.792951 25275 raft_consensus.cc:686] T a9f18d3fda934873a6f4bb8328e14b92 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:29.793277 25269 ts_tablet_manager.cc:1428] T a9f18d3fda934873a6f4bb8328e14b92 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260807 18:14:29.793228 25275 consensus_queue.cc:237] T a9f18d3fda934873a6f4bb8328e14b92 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.797248 24956 catalog_manager.cc:5495] T a9f18d3fda934873a6f4bb8328e14b92 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:29.817476 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.024s user 0.020s sys 0.003s Metrics: {"bytes_written":336,"cfile_cache_hit":12,"cfile_cache_hit_bytes":11094,"cfile_cache_miss":28,"cfile_cache_miss_bytes":16466,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":651,"dirs.run_cpu_time_us":450,"dirs.run_wall_time_us":2481,"drs_written":1,"lbm_read_time_us":1009,"lbm_reads_lt_1ms":60,"lbm_write_time_us":1231,"lbm_writes_lt_1ms":31,"mutex_wait_us":151,"num_input_rowsets":2,"peak_mem_usage":6818,"reinsert_count":0,"rows_written":55,"spinlock_wait_cycles":4864,"update_count":1}
I20260807 18:14:29.818387 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 2453 bytes on disk
I20260807 18:14:29.819018 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":109,"lbm_reads_lt_1ms":4}
I20260807 18:14:29.831143 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49410:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:29.842859 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 1b0928a2cf384b0aab998afdf2fd19be (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.27 [id=976900a341a94148880648379d303370]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:29.843376 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b0928a2cf384b0aab998afdf2fd19be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:29.848835 25269 tablet_bootstrap.cc:492] T 1b0928a2cf384b0aab998afdf2fd19be P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:29.850471 25269 tablet_bootstrap.cc:654] T 1b0928a2cf384b0aab998afdf2fd19be P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:29.852543 25269 tablet_bootstrap.cc:492] T 1b0928a2cf384b0aab998afdf2fd19be P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:29.852825 25269 ts_tablet_manager.cc:1397] T 1b0928a2cf384b0aab998afdf2fd19be P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260807 18:14:29.853559 25269 raft_consensus.cc:348] T 1b0928a2cf384b0aab998afdf2fd19be P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.853756 25269 raft_consensus.cc:374] T 1b0928a2cf384b0aab998afdf2fd19be P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:29.853839 25269 raft_consensus.cc:729] T 1b0928a2cf384b0aab998afdf2fd19be P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:29.854117 25269 consensus_queue.cc:260] T 1b0928a2cf384b0aab998afdf2fd19be P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.854341 25269 raft_consensus.cc:388] T 1b0928a2cf384b0aab998afdf2fd19be P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:29.854460 25269 raft_consensus.cc:482] T 1b0928a2cf384b0aab998afdf2fd19be P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:29.854570 25269 raft_consensus.cc:3037] T 1b0928a2cf384b0aab998afdf2fd19be P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:29.856631 25269 raft_consensus.cc:504] T 1b0928a2cf384b0aab998afdf2fd19be P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.856941 25269 leader_election.cc:302] T 1b0928a2cf384b0aab998afdf2fd19be P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:29.857199 25269 leader_election.cc:288] T 1b0928a2cf384b0aab998afdf2fd19be P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:29.857241 25275 raft_consensus.cc:2781] T 1b0928a2cf384b0aab998afdf2fd19be P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:29.857411 25275 raft_consensus.cc:686] T 1b0928a2cf384b0aab998afdf2fd19be P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:29.857664 25275 consensus_queue.cc:237] T 1b0928a2cf384b0aab998afdf2fd19be P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.858717 25269 ts_tablet_manager.cc:1428] T 1b0928a2cf384b0aab998afdf2fd19be P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 18:14:29.860898 24956 catalog_manager.cc:5495] T 1b0928a2cf384b0aab998afdf2fd19be P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:29.891971 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000077
I20260807 18:14:29.901418 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49426:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.28"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:29.903882 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.005s sys 0.004s Metrics: {"bytes_written":6495,"cfile_init":1,"dirs.queue_time_us":71,"dirs.run_cpu_time_us":242,"dirs.run_wall_time_us":1446,"drs_written":1,"lbm_read_time_us":59,"lbm_reads_lt_1ms":4,"lbm_write_time_us":859,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":8}
I20260807 18:14:29.904685 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 633 bytes on disk
I20260807 18:14:29.905364 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":90,"lbm_reads_lt_1ms":4}
I20260807 18:14:29.905992 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.327749
I20260807 18:14:29.914851 25147 tablet_service.cc:1467] Processing CreateTablet for tablet ba97d48c898d44bc94f071062d362162 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.28 [id=8d22157e1a0d42199d2b9cf049d06f71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:29.915354 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba97d48c898d44bc94f071062d362162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:29.920246 25269 tablet_bootstrap.cc:492] T ba97d48c898d44bc94f071062d362162 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:29.922073 25269 tablet_bootstrap.cc:654] T ba97d48c898d44bc94f071062d362162 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:29.924587 25269 tablet_bootstrap.cc:492] T ba97d48c898d44bc94f071062d362162 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:29.924748 25269 ts_tablet_manager.cc:1397] T ba97d48c898d44bc94f071062d362162 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 18:14:29.925565 25269 raft_consensus.cc:348] T ba97d48c898d44bc94f071062d362162 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.925774 25269 raft_consensus.cc:374] T ba97d48c898d44bc94f071062d362162 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:29.925887 25269 raft_consensus.cc:729] T ba97d48c898d44bc94f071062d362162 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:29.926218 25269 consensus_queue.cc:260] T ba97d48c898d44bc94f071062d362162 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.926453 25269 raft_consensus.cc:388] T ba97d48c898d44bc94f071062d362162 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:29.926554 25269 raft_consensus.cc:482] T ba97d48c898d44bc94f071062d362162 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:29.926666 25269 raft_consensus.cc:3037] T ba97d48c898d44bc94f071062d362162 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:29.928866 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.023s user 0.019s sys 0.003s Metrics: {"bytes_written":17929,"cfile_cache_hit":12,"cfile_cache_hit_bytes":11489,"cfile_cache_miss":28,"cfile_cache_miss_bytes":17331,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":844,"dirs.run_cpu_time_us":804,"dirs.run_wall_time_us":3553,"drs_written":1,"lbm_read_time_us":1135,"lbm_reads_lt_1ms":56,"lbm_write_time_us":806,"lbm_writes_lt_1ms":27,"mutex_wait_us":366,"num_input_rowsets":2,"peak_mem_usage":6308,"rows_written":57,"spinlock_wait_cycles":3328}
I20260807 18:14:29.929416 25269 raft_consensus.cc:504] T ba97d48c898d44bc94f071062d362162 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.929767 25269 leader_election.cc:302] T ba97d48c898d44bc94f071062d362162 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:29.929994 25269 leader_election.cc:288] T ba97d48c898d44bc94f071062d362162 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:29.929991 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 2570 bytes on disk
I20260807 18:14:29.930075 25275 raft_consensus.cc:2781] T ba97d48c898d44bc94f071062d362162 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:29.930220 25275 raft_consensus.cc:686] T ba97d48c898d44bc94f071062d362162 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:29.930491 25275 consensus_queue.cc:237] T ba97d48c898d44bc94f071062d362162 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:29.930927 25269 ts_tablet_manager.cc:1428] T ba97d48c898d44bc94f071062d362162 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260807 18:14:29.931938 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":97,"lbm_reads_lt_1ms":4}
I20260807 18:14:29.932521 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000008
I20260807 18:14:29.934500 24957 catalog_manager.cc:5495] T ba97d48c898d44bc94f071062d362162 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:29.949476 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.016s user 0.007s sys 0.007s Metrics: {"bytes_written":331,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":60,"dirs.run_cpu_time_us":191,"dirs.run_wall_time_us":1002,"drs_written":1,"lbm_read_time_us":77,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1079,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":2,"update_count":1}
I20260807 18:14:29.950305 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.458449
I20260807 18:14:29.959625 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.009s user 0.007s sys 0.000s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":574,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"lbm_read_time_us":373,"lbm_reads_lt_1ms":21,"lbm_write_time_us":291,"lbm_writes_lt_1ms":9,"reinsert_count":0,"update_count":1}
I20260807 18:14:29.960357 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 235 bytes on disk
I20260807 18:14:29.960959 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":84,"lbm_reads_lt_1ms":4}
I20260807 18:14:29.961666 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.251949
I20260807 18:14:29.986021 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.024s user 0.016s sys 0.008s Metrics: {"bytes_written":18357,"cfile_cache_hit":13,"cfile_cache_hit_bytes":11900,"cfile_cache_miss":31,"cfile_cache_miss_bytes":18040,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":666,"dirs.run_cpu_time_us":559,"dirs.run_wall_time_us":2916,"drs_written":1,"lbm_read_time_us":1239,"lbm_reads_lt_1ms":63,"lbm_write_time_us":905,"lbm_writes_lt_1ms":27,"mutex_wait_us":33,"num_input_rowsets":2,"peak_mem_usage":7532,"rows_written":59,"spinlock_wait_cycles":2432}
I20260807 18:14:29.986927 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 2671 bytes on disk
I20260807 18:14:29.987851 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":76,"lbm_reads_lt_1ms":4}
I20260807 18:14:29.996539 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49430:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:30.008788 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 753bd6871e11426ba6adab05241ba30b (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.29 [id=be91c98f4243422cbf1a5474bd5897ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:30.009260 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 753bd6871e11426ba6adab05241ba30b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:30.013895 25269 tablet_bootstrap.cc:492] T 753bd6871e11426ba6adab05241ba30b P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:30.015682 25269 tablet_bootstrap.cc:654] T 753bd6871e11426ba6adab05241ba30b P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:30.018208 25269 tablet_bootstrap.cc:492] T 753bd6871e11426ba6adab05241ba30b P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:30.018373 25269 ts_tablet_manager.cc:1397] T 753bd6871e11426ba6adab05241ba30b P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20260807 18:14:30.019189 25269 raft_consensus.cc:348] T 753bd6871e11426ba6adab05241ba30b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.019448 25269 raft_consensus.cc:374] T 753bd6871e11426ba6adab05241ba30b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:30.019552 25269 raft_consensus.cc:729] T 753bd6871e11426ba6adab05241ba30b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:30.019850 25269 consensus_queue.cc:260] T 753bd6871e11426ba6adab05241ba30b P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.020053 25269 raft_consensus.cc:388] T 753bd6871e11426ba6adab05241ba30b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:30.020159 25269 raft_consensus.cc:482] T 753bd6871e11426ba6adab05241ba30b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:30.020259 25269 raft_consensus.cc:3037] T 753bd6871e11426ba6adab05241ba30b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:30.023212 25269 raft_consensus.cc:504] T 753bd6871e11426ba6adab05241ba30b P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.023481 25269 leader_election.cc:302] T 753bd6871e11426ba6adab05241ba30b P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:30.023703 25269 leader_election.cc:288] T 753bd6871e11426ba6adab05241ba30b P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:30.023811 25275 raft_consensus.cc:2781] T 753bd6871e11426ba6adab05241ba30b P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:30.024036 25275 raft_consensus.cc:686] T 753bd6871e11426ba6adab05241ba30b P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:30.024309 25275 consensus_queue.cc:237] T 753bd6871e11426ba6adab05241ba30b P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.024744 25269 ts_tablet_manager.cc:1428] T 753bd6871e11426ba6adab05241ba30b P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260807 18:14:30.029556 24957 catalog_manager.cc:5495] T 753bd6871e11426ba6adab05241ba30b P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:30.069988 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000077
I20260807 18:14:30.073928 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49444:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.30"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:30.082047 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.011s sys 0.000s Metrics: {"bytes_written":6066,"cfile_init":1,"dirs.queue_time_us":70,"dirs.run_cpu_time_us":228,"dirs.run_wall_time_us":1421,"drs_written":1,"lbm_read_time_us":87,"lbm_reads_lt_1ms":4,"lbm_write_time_us":836,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:30.083087 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.295066
I20260807 18:14:30.089644 25147 tablet_service.cc:1467] Processing CreateTablet for tablet f458cb4e16d543aba7c7a6d52f49ddb3 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.30 [id=1e8820482eae4f98a86d779f03585142]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:30.090196 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f458cb4e16d543aba7c7a6d52f49ddb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:30.096925 25269 tablet_bootstrap.cc:492] T f458cb4e16d543aba7c7a6d52f49ddb3 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:30.099009 25269 tablet_bootstrap.cc:654] T f458cb4e16d543aba7c7a6d52f49ddb3 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:30.101725 25269 tablet_bootstrap.cc:492] T f458cb4e16d543aba7c7a6d52f49ddb3 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:30.101909 25269 ts_tablet_manager.cc:1397] T f458cb4e16d543aba7c7a6d52f49ddb3 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 18:14:30.102571 25269 raft_consensus.cc:348] T f458cb4e16d543aba7c7a6d52f49ddb3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.102777 25269 raft_consensus.cc:374] T f458cb4e16d543aba7c7a6d52f49ddb3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:30.102877 25269 raft_consensus.cc:729] T f458cb4e16d543aba7c7a6d52f49ddb3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:30.103142 25269 consensus_queue.cc:260] T f458cb4e16d543aba7c7a6d52f49ddb3 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.103348 25269 raft_consensus.cc:388] T f458cb4e16d543aba7c7a6d52f49ddb3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:30.103428 25269 raft_consensus.cc:482] T f458cb4e16d543aba7c7a6d52f49ddb3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:30.103560 25269 raft_consensus.cc:3037] T f458cb4e16d543aba7c7a6d52f49ddb3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:30.105805 25269 raft_consensus.cc:504] T f458cb4e16d543aba7c7a6d52f49ddb3 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.106137 25269 leader_election.cc:302] T f458cb4e16d543aba7c7a6d52f49ddb3 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:30.106367 25269 leader_election.cc:288] T f458cb4e16d543aba7c7a6d52f49ddb3 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:30.106500 25275 raft_consensus.cc:2781] T f458cb4e16d543aba7c7a6d52f49ddb3 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:30.107193 25275 raft_consensus.cc:686] T f458cb4e16d543aba7c7a6d52f49ddb3 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:30.107546 25275 consensus_queue.cc:237] T f458cb4e16d543aba7c7a6d52f49ddb3 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.111732 25269 ts_tablet_manager.cc:1428] T f458cb4e16d543aba7c7a6d52f49ddb3 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20260807 18:14:30.111749 24957 catalog_manager.cc:5495] T f458cb4e16d543aba7c7a6d52f49ddb3 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:30.115772 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.032s user 0.012s sys 0.012s Metrics: {"bytes_written":18798,"cfile_cache_hit":13,"cfile_cache_hit_bytes":12226,"cfile_cache_miss":31,"cfile_cache_miss_bytes":18798,"cfile_init":9,"delta_iterators_relevant":6,"dirs.queue_time_us":78,"dirs.run_cpu_time_us":182,"dirs.run_wall_time_us":1195,"drs_written":1,"lbm_read_time_us":1506,"lbm_reads_lt_1ms":67,"lbm_write_time_us":963,"lbm_writes_lt_1ms":27,"num_input_rowsets":2,"peak_mem_usage":7121,"rows_written":61}
I20260807 18:14:30.116878 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 2771 bytes on disk
I20260807 18:14:30.117529 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":83,"lbm_reads_lt_1ms":4}
I20260807 18:14:30.118240 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000010
I20260807 18:14:30.133718 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.015s user 0.015s sys 0.000s Metrics: {"bytes_written":331,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":905,"dirs.run_cpu_time_us":225,"dirs.run_wall_time_us":1140,"drs_written":1,"lbm_read_time_us":92,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1212,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":2,"update_count":1}
I20260807 18:14:30.134918 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 235 bytes on disk
I20260807 18:14:30.136268 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":75,"lbm_reads_lt_1ms":4}
I20260807 18:14:30.137060 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.458449
I20260807 18:14:30.146706 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.009s user 0.009s sys 0.000s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":574,"cfile_init":3,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":135,"lbm_read_time_us":337,"lbm_reads_lt_1ms":17,"lbm_write_time_us":354,"lbm_writes_lt_1ms":9,"mutex_wait_us":23,"reinsert_count":0,"spinlock_wait_cycles":1920,"update_count":1}
I20260807 18:14:30.147445 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.272324
I20260807 18:14:30.165934 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49460:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:30.173437 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.026s user 0.025s sys 0.000s Metrics: {"bytes_written":19229,"cfile_cache_hit":13,"cfile_cache_hit_bytes":12638,"cfile_cache_miss":31,"cfile_cache_miss_bytes":19178,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":1860,"dirs.run_cpu_time_us":823,"dirs.run_wall_time_us":4081,"drs_written":1,"lbm_read_time_us":1420,"lbm_reads_lt_1ms":63,"lbm_write_time_us":1104,"lbm_writes_lt_1ms":27,"mutex_wait_us":283,"num_input_rowsets":2,"peak_mem_usage":8450,"rows_written":63}
I20260807 18:14:30.174516 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 2876 bytes on disk
I20260807 18:14:30.175153 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":83,"lbm_reads_lt_1ms":4}
I20260807 18:14:30.175812 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000012
I20260807 18:14:30.179271 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 2d296e74b8bd4147b8fd7e18b9ebaaf5 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.31 [id=865c19c33a374be492cf27014d9178df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:30.179759 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d296e74b8bd4147b8fd7e18b9ebaaf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:30.184686 25269 tablet_bootstrap.cc:492] T 2d296e74b8bd4147b8fd7e18b9ebaaf5 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:30.186414 25269 tablet_bootstrap.cc:654] T 2d296e74b8bd4147b8fd7e18b9ebaaf5 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:30.188022 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.004s sys 0.005s Metrics: {"bytes_written":329,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":57,"dirs.run_cpu_time_us":168,"dirs.run_wall_time_us":1082,"drs_written":1,"lbm_read_time_us":55,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1054,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":2,"update_count":1}
I20260807 18:14:30.188634 25269 tablet_bootstrap.cc:492] T 2d296e74b8bd4147b8fd7e18b9ebaaf5 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:30.188827 25269 ts_tablet_manager.cc:1397] T 2d296e74b8bd4147b8fd7e18b9ebaaf5 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.002s
I20260807 18:14:30.188964 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 167 bytes on disk
I20260807 18:14:30.189612 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":124,"lbm_reads_lt_1ms":4}
I20260807 18:14:30.189657 25269 raft_consensus.cc:348] T 2d296e74b8bd4147b8fd7e18b9ebaaf5 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.189885 25269 raft_consensus.cc:374] T 2d296e74b8bd4147b8fd7e18b9ebaaf5 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:30.189981 25269 raft_consensus.cc:729] T 2d296e74b8bd4147b8fd7e18b9ebaaf5 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:30.190229 25269 consensus_queue.cc:260] T 2d296e74b8bd4147b8fd7e18b9ebaaf5 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.190294 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.540230
I20260807 18:14:30.190421 25269 raft_consensus.cc:388] T 2d296e74b8bd4147b8fd7e18b9ebaaf5 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:30.190557 25269 raft_consensus.cc:482] T 2d296e74b8bd4147b8fd7e18b9ebaaf5 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:30.190706 25269 raft_consensus.cc:3037] T 2d296e74b8bd4147b8fd7e18b9ebaaf5 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:30.192898 25269 raft_consensus.cc:504] T 2d296e74b8bd4147b8fd7e18b9ebaaf5 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.193157 25269 leader_election.cc:302] T 2d296e74b8bd4147b8fd7e18b9ebaaf5 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:30.193425 25269 leader_election.cc:288] T 2d296e74b8bd4147b8fd7e18b9ebaaf5 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:30.193516 25275 raft_consensus.cc:2781] T 2d296e74b8bd4147b8fd7e18b9ebaaf5 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:30.193749 25275 raft_consensus.cc:686] T 2d296e74b8bd4147b8fd7e18b9ebaaf5 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:30.194049 25269 ts_tablet_manager.cc:1428] T 2d296e74b8bd4147b8fd7e18b9ebaaf5 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
I20260807 18:14:30.194054 25275 consensus_queue.cc:237] T 2d296e74b8bd4147b8fd7e18b9ebaaf5 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.197906 24956 catalog_manager.cc:5495] T 2d296e74b8bd4147b8fd7e18b9ebaaf5 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:30.200269 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.010s user 0.002s sys 0.003s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":459,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":200,"lbm_read_time_us":351,"lbm_reads_lt_1ms":21,"lbm_write_time_us":322,"lbm_writes_lt_1ms":9,"reinsert_count":0,"update_count":1}
I20260807 18:14:30.201375 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.230036
I20260807 18:14:30.224879 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.023s user 0.022s sys 0.000s Metrics: {"bytes_written":336,"cfile_cache_hit":13,"cfile_cache_hit_bytes":12967,"cfile_cache_miss":31,"cfile_cache_miss_bytes":19363,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":6,"dirs.queue_time_us":1078,"dirs.run_cpu_time_us":593,"dirs.run_wall_time_us":3128,"drs_written":1,"lbm_read_time_us":1159,"lbm_reads_lt_1ms":63,"lbm_write_time_us":891,"lbm_writes_lt_1ms":31,"mutex_wait_us":118,"num_input_rowsets":2,"peak_mem_usage":8914,"reinsert_count":0,"rows_written":65,"spinlock_wait_cycles":1792,"thread_start_us":314,"threads_started":1,"update_count":1}
I20260807 18:14:30.226032 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 2943 bytes on disk
I20260807 18:14:30.226706 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":96,"lbm_reads_lt_1ms":4}
I20260807 18:14:30.233036 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49470:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:30.238866 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000080
I20260807 18:14:30.246065 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 270a65af252f4fd2bbf8e3af00ca41db (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.32 [id=af056fa736e543acbb1f0ae6bdee9978]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:30.246655 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 270a65af252f4fd2bbf8e3af00ca41db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:30.253028 25269 tablet_bootstrap.cc:492] T 270a65af252f4fd2bbf8e3af00ca41db P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:30.253923 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.015s user 0.014s sys 0.000s Metrics: {"bytes_written":329,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":63,"dirs.run_cpu_time_us":198,"dirs.run_wall_time_us":1206,"drs_written":1,"lbm_read_time_us":94,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1314,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":8,"update_count":1}
I20260807 18:14:30.254913 25269 tablet_bootstrap.cc:654] T 270a65af252f4fd2bbf8e3af00ca41db P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:30.255111 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 577 bytes on disk
I20260807 18:14:30.255908 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":114,"lbm_reads_lt_1ms":4}
I20260807 18:14:30.256606 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.325583
I20260807 18:14:30.257736 25269 tablet_bootstrap.cc:492] T 270a65af252f4fd2bbf8e3af00ca41db P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:30.257905 25269 ts_tablet_manager.cc:1397] T 270a65af252f4fd2bbf8e3af00ca41db P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 18:14:30.258802 25269 raft_consensus.cc:348] T 270a65af252f4fd2bbf8e3af00ca41db P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.259039 25269 raft_consensus.cc:374] T 270a65af252f4fd2bbf8e3af00ca41db P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:30.259171 25269 raft_consensus.cc:729] T 270a65af252f4fd2bbf8e3af00ca41db P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:30.259419 25269 consensus_queue.cc:260] T 270a65af252f4fd2bbf8e3af00ca41db P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.259708 25269 raft_consensus.cc:388] T 270a65af252f4fd2bbf8e3af00ca41db P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:30.259815 25269 raft_consensus.cc:482] T 270a65af252f4fd2bbf8e3af00ca41db P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:30.259929 25269 raft_consensus.cc:3037] T 270a65af252f4fd2bbf8e3af00ca41db P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:30.262730 25269 raft_consensus.cc:504] T 270a65af252f4fd2bbf8e3af00ca41db P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.263042 25269 leader_election.cc:302] T 270a65af252f4fd2bbf8e3af00ca41db P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:30.263285 25269 leader_election.cc:288] T 270a65af252f4fd2bbf8e3af00ca41db P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:30.263414 25275 raft_consensus.cc:2781] T 270a65af252f4fd2bbf8e3af00ca41db P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:30.263623 25275 raft_consensus.cc:686] T 270a65af252f4fd2bbf8e3af00ca41db P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:30.263962 25269 ts_tablet_manager.cc:1428] T 270a65af252f4fd2bbf8e3af00ca41db P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 18:14:30.263866 25275 consensus_queue.cc:237] T 270a65af252f4fd2bbf8e3af00ca41db P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.268036 24956 catalog_manager.cc:5495] T 270a65af252f4fd2bbf8e3af00ca41db P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:30.282193 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.025s user 0.024s sys 0.000s Metrics: {"bytes_written":20067,"cfile_cache_hit":13,"cfile_cache_hit_bytes":13213,"cfile_cache_miss":31,"cfile_cache_miss_bytes":20235,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":839,"dirs.run_cpu_time_us":969,"dirs.run_wall_time_us":4993,"drs_written":1,"lbm_read_time_us":1460,"lbm_reads_lt_1ms":63,"lbm_write_time_us":1003,"lbm_writes_lt_1ms":27,"mutex_wait_us":231,"num_input_rowsets":2,"peak_mem_usage":7991,"rows_written":67,"spinlock_wait_cycles":12800,"thread_start_us":617,"threads_started":1}
I20260807 18:14:30.283129 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.000002
I20260807 18:14:30.287094 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.004s user 0.002s sys 0.000s Metrics: {"bytes_written":336,"delete_count":0,"lbm_write_time_us":141,"lbm_writes_lt_1ms":4,"reinsert_count":0,"update_count":1}
I20260807 18:14:30.287649 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 3026 bytes on disk
I20260807 18:14:30.288271 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":78,"lbm_reads_lt_1ms":4}
I20260807 18:14:30.305567 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49482:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.33"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:30.318066 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 3621e415aeb6492cbfe09c98c4bcfe83 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.33 [id=120abf34ffe64292834edda4640b052d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:30.318596 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3621e415aeb6492cbfe09c98c4bcfe83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:30.323323 25269 tablet_bootstrap.cc:492] T 3621e415aeb6492cbfe09c98c4bcfe83 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:30.324772 25269 tablet_bootstrap.cc:654] T 3621e415aeb6492cbfe09c98c4bcfe83 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:30.327265 25269 tablet_bootstrap.cc:492] T 3621e415aeb6492cbfe09c98c4bcfe83 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:30.327405 25269 ts_tablet_manager.cc:1397] T 3621e415aeb6492cbfe09c98c4bcfe83 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260807 18:14:30.328001 25269 raft_consensus.cc:348] T 3621e415aeb6492cbfe09c98c4bcfe83 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.328184 25269 raft_consensus.cc:374] T 3621e415aeb6492cbfe09c98c4bcfe83 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:30.328241 25269 raft_consensus.cc:729] T 3621e415aeb6492cbfe09c98c4bcfe83 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:30.328490 25269 consensus_queue.cc:260] T 3621e415aeb6492cbfe09c98c4bcfe83 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.328642 25269 raft_consensus.cc:388] T 3621e415aeb6492cbfe09c98c4bcfe83 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:30.328715 25269 raft_consensus.cc:482] T 3621e415aeb6492cbfe09c98c4bcfe83 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:30.328783 25269 raft_consensus.cc:3037] T 3621e415aeb6492cbfe09c98c4bcfe83 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:30.331032 25269 raft_consensus.cc:504] T 3621e415aeb6492cbfe09c98c4bcfe83 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.331265 25269 leader_election.cc:302] T 3621e415aeb6492cbfe09c98c4bcfe83 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:30.331489 25269 leader_election.cc:288] T 3621e415aeb6492cbfe09c98c4bcfe83 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:30.331583 25275 raft_consensus.cc:2781] T 3621e415aeb6492cbfe09c98c4bcfe83 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:30.331801 25275 raft_consensus.cc:686] T 3621e415aeb6492cbfe09c98c4bcfe83 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:30.331946 25269 ts_tablet_manager.cc:1428] T 3621e415aeb6492cbfe09c98c4bcfe83 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260807 18:14:30.332134 25275 consensus_queue.cc:237] T 3621e415aeb6492cbfe09c98c4bcfe83 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.335978 24956 catalog_manager.cc:5495] T 3621e415aeb6492cbfe09c98c4bcfe83 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:30.366638 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49494:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:30.378365 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 2cd0b8e7850a471cb9a0fca7c6ab4441 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.34 [id=93829efa29414dd986b6505e94c1734e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:30.378911 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cd0b8e7850a471cb9a0fca7c6ab4441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:30.383898 25269 tablet_bootstrap.cc:492] T 2cd0b8e7850a471cb9a0fca7c6ab4441 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:30.385638 25269 tablet_bootstrap.cc:654] T 2cd0b8e7850a471cb9a0fca7c6ab4441 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:30.388154 25269 tablet_bootstrap.cc:492] T 2cd0b8e7850a471cb9a0fca7c6ab4441 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:30.388289 25269 ts_tablet_manager.cc:1397] T 2cd0b8e7850a471cb9a0fca7c6ab4441 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260807 18:14:30.388931 25269 raft_consensus.cc:348] T 2cd0b8e7850a471cb9a0fca7c6ab4441 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.389118 25269 raft_consensus.cc:374] T 2cd0b8e7850a471cb9a0fca7c6ab4441 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:30.389196 25269 raft_consensus.cc:729] T 2cd0b8e7850a471cb9a0fca7c6ab4441 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:30.389474 25269 consensus_queue.cc:260] T 2cd0b8e7850a471cb9a0fca7c6ab4441 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.389712 25269 raft_consensus.cc:388] T 2cd0b8e7850a471cb9a0fca7c6ab4441 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:30.389823 25269 raft_consensus.cc:482] T 2cd0b8e7850a471cb9a0fca7c6ab4441 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:30.389981 25269 raft_consensus.cc:3037] T 2cd0b8e7850a471cb9a0fca7c6ab4441 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:30.392019 25269 raft_consensus.cc:504] T 2cd0b8e7850a471cb9a0fca7c6ab4441 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.392338 25269 leader_election.cc:302] T 2cd0b8e7850a471cb9a0fca7c6ab4441 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:30.392570 25269 leader_election.cc:288] T 2cd0b8e7850a471cb9a0fca7c6ab4441 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:30.392673 25275 raft_consensus.cc:2781] T 2cd0b8e7850a471cb9a0fca7c6ab4441 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:30.392831 25275 raft_consensus.cc:686] T 2cd0b8e7850a471cb9a0fca7c6ab4441 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:30.393193 25269 ts_tablet_manager.cc:1428] T 2cd0b8e7850a471cb9a0fca7c6ab4441 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260807 18:14:30.393124 25275 consensus_queue.cc:237] T 2cd0b8e7850a471cb9a0fca7c6ab4441 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.396911 24957 catalog_manager.cc:5495] T 2cd0b8e7850a471cb9a0fca7c6ab4441 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:30.431003 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49506:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.35"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:30.442564 25147 tablet_service.cc:1467] Processing CreateTablet for tablet d11cbdffe6e24044b7be51f5b7241992 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.35 [id=09addf35501a446e9c7f556327f4baf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:30.443126 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d11cbdffe6e24044b7be51f5b7241992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:30.448146 25269 tablet_bootstrap.cc:492] T d11cbdffe6e24044b7be51f5b7241992 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:30.449726 25269 tablet_bootstrap.cc:654] T d11cbdffe6e24044b7be51f5b7241992 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:30.451998 25269 tablet_bootstrap.cc:492] T d11cbdffe6e24044b7be51f5b7241992 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:30.452226 25269 ts_tablet_manager.cc:1397] T d11cbdffe6e24044b7be51f5b7241992 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260807 18:14:30.452952 25269 raft_consensus.cc:348] T d11cbdffe6e24044b7be51f5b7241992 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.453189 25269 raft_consensus.cc:374] T d11cbdffe6e24044b7be51f5b7241992 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:30.453293 25269 raft_consensus.cc:729] T d11cbdffe6e24044b7be51f5b7241992 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:30.453668 25269 consensus_queue.cc:260] T d11cbdffe6e24044b7be51f5b7241992 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.453917 25269 raft_consensus.cc:388] T d11cbdffe6e24044b7be51f5b7241992 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:30.454064 25269 raft_consensus.cc:482] T d11cbdffe6e24044b7be51f5b7241992 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:30.454180 25269 raft_consensus.cc:3037] T d11cbdffe6e24044b7be51f5b7241992 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:30.456816 25269 raft_consensus.cc:504] T d11cbdffe6e24044b7be51f5b7241992 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.457113 25269 leader_election.cc:302] T d11cbdffe6e24044b7be51f5b7241992 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:30.457479 25269 leader_election.cc:288] T d11cbdffe6e24044b7be51f5b7241992 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:30.457525 25275 raft_consensus.cc:2781] T d11cbdffe6e24044b7be51f5b7241992 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:30.457901 25275 raft_consensus.cc:686] T d11cbdffe6e24044b7be51f5b7241992 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:30.458149 25269 ts_tablet_manager.cc:1428] T d11cbdffe6e24044b7be51f5b7241992 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 18:14:30.458169 25275 consensus_queue.cc:237] T d11cbdffe6e24044b7be51f5b7241992 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.462213 24957 catalog_manager.cc:5495] T d11cbdffe6e24044b7be51f5b7241992 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:30.477737 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000080
I20260807 18:14:30.489655 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.011s sys 0.000s Metrics: {"bytes_written":6495,"cfile_init":1,"dirs.queue_time_us":65,"dirs.run_cpu_time_us":182,"dirs.run_wall_time_us":1416,"drs_written":1,"lbm_read_time_us":85,"lbm_reads_lt_1ms":4,"lbm_write_time_us":817,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":8}
I20260807 18:14:30.490669 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.306387
I20260807 18:14:30.500437 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49510:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:30.513617 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 62cbcd0a4aa441c48c9cc772d02cf6d4 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.36 [id=81353755300e46e2bbef13fd7d3ab24c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:30.514124 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62cbcd0a4aa441c48c9cc772d02cf6d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:30.515218 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.024s user 0.012s sys 0.011s Metrics: {"bytes_written":21431,"cfile_cache_hit":13,"cfile_cache_hit_bytes":14438,"cfile_cache_miss":31,"cfile_cache_miss_bytes":22062,"cfile_init":9,"delta_iterators_relevant":6,"dirs.queue_time_us":820,"dirs.run_cpu_time_us":223,"dirs.run_wall_time_us":1256,"drs_written":1,"lbm_read_time_us":1300,"lbm_reads_lt_1ms":67,"lbm_write_time_us":907,"lbm_writes_lt_1ms":27,"mutex_wait_us":50,"num_input_rowsets":2,"peak_mem_usage":9217,"rows_written":73,"spinlock_wait_cycles":1792}
I20260807 18:14:30.516053 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 3281 bytes on disk
I20260807 18:14:30.516852 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":100,"lbm_reads_lt_1ms":4}
I20260807 18:14:30.517549 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000008
I20260807 18:14:30.520681 25269 tablet_bootstrap.cc:492] T 62cbcd0a4aa441c48c9cc772d02cf6d4 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:30.522583 25269 tablet_bootstrap.cc:654] T 62cbcd0a4aa441c48c9cc772d02cf6d4 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:30.525164 25269 tablet_bootstrap.cc:492] T 62cbcd0a4aa441c48c9cc772d02cf6d4 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:30.525317 25269 ts_tablet_manager.cc:1397] T 62cbcd0a4aa441c48c9cc772d02cf6d4 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 18:14:30.526134 25269 raft_consensus.cc:348] T 62cbcd0a4aa441c48c9cc772d02cf6d4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.526301 25269 raft_consensus.cc:374] T 62cbcd0a4aa441c48c9cc772d02cf6d4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:30.526410 25269 raft_consensus.cc:729] T 62cbcd0a4aa441c48c9cc772d02cf6d4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:30.526669 25269 consensus_queue.cc:260] T 62cbcd0a4aa441c48c9cc772d02cf6d4 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.526850 25269 raft_consensus.cc:388] T 62cbcd0a4aa441c48c9cc772d02cf6d4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:30.526935 25269 raft_consensus.cc:482] T 62cbcd0a4aa441c48c9cc772d02cf6d4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:30.527065 25269 raft_consensus.cc:3037] T 62cbcd0a4aa441c48c9cc772d02cf6d4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:30.528888 25269 raft_consensus.cc:504] T 62cbcd0a4aa441c48c9cc772d02cf6d4 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.529181 25269 leader_election.cc:302] T 62cbcd0a4aa441c48c9cc772d02cf6d4 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:30.529844 25269 leader_election.cc:288] T 62cbcd0a4aa441c48c9cc772d02cf6d4 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:30.529927 25275 raft_consensus.cc:2781] T 62cbcd0a4aa441c48c9cc772d02cf6d4 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:30.530128 25275 raft_consensus.cc:686] T 62cbcd0a4aa441c48c9cc772d02cf6d4 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:30.530370 25275 consensus_queue.cc:237] T 62cbcd0a4aa441c48c9cc772d02cf6d4 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.530558 25269 ts_tablet_manager.cc:1428] T 62cbcd0a4aa441c48c9cc772d02cf6d4 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 18:14:30.530570 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.011s sys 0.000s Metrics: {"bytes_written":5157,"cfile_init":1,"dirs.queue_time_us":60,"dirs.run_cpu_time_us":195,"dirs.run_wall_time_us":1216,"drs_written":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4,"lbm_write_time_us":992,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:30.531498 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 235 bytes on disk
I20260807 18:14:30.532145 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":105,"lbm_reads_lt_1ms":4}
I20260807 18:14:30.532824 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.214374
I20260807 18:14:30.533943 24956 catalog_manager.cc:5495] T 62cbcd0a4aa441c48c9cc772d02cf6d4 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:30.539137 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000079
I20260807 18:14:30.558092 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.014s user 0.011s sys 0.000s Metrics: {"bytes_written":6459,"cfile_init":1,"dirs.queue_time_us":79,"dirs.run_cpu_time_us":187,"dirs.run_wall_time_us":1200,"drs_written":1,"lbm_read_time_us":78,"lbm_reads_lt_1ms":4,"lbm_write_time_us":615,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":8}
I20260807 18:14:30.559371 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 587 bytes on disk
I20260807 18:14:30.560011 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":74,"lbm_reads_lt_1ms":4}
I20260807 18:14:30.560698 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.302461
I20260807 18:14:30.561465 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.028s user 0.023s sys 0.003s Metrics: {"bytes_written":336,"cfile_cache_hit":12,"cfile_cache_hit_bytes":14784,"cfile_cache_miss":28,"cfile_cache_miss_bytes":21988,"cfile_init":7,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":851,"dirs.run_cpu_time_us":187,"dirs.run_wall_time_us":2626,"drs_written":1,"lbm_read_time_us":1147,"lbm_reads_lt_1ms":56,"lbm_write_time_us":1213,"lbm_writes_lt_1ms":31,"mutex_wait_us":35,"num_input_rowsets":2,"peak_mem_usage":10189,"reinsert_count":0,"rows_written":75,"update_count":1}
I20260807 18:14:30.562285 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 3345 bytes on disk
I20260807 18:14:30.562913 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":96,"lbm_reads_lt_1ms":4}
I20260807 18:14:30.581636 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49522:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.37"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:30.586833 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.026s user 0.022s sys 0.003s Metrics: {"bytes_written":21860,"cfile_cache_hit":13,"cfile_cache_hit_bytes":14765,"cfile_cache_miss":31,"cfile_cache_miss_bytes":22535,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":699,"dirs.run_cpu_time_us":276,"dirs.run_wall_time_us":1159,"drs_written":1,"lbm_read_time_us":1243,"lbm_reads_lt_1ms":63,"lbm_write_time_us":904,"lbm_writes_lt_1ms":27,"mutex_wait_us":82,"num_input_rowsets":2,"peak_mem_usage":9472,"rows_written":75,"spinlock_wait_cycles":3456}
I20260807 18:14:30.587903 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 3360 bytes on disk
I20260807 18:14:30.590126 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":94,"lbm_reads_lt_1ms":4}
I20260807 18:14:30.590847 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000010
I20260807 18:14:30.595376 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 9200e607002a41a390767e5f3be808e7 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.37 [id=6c011fb670cd448cb99e70ef6effc52b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:30.595928 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9200e607002a41a390767e5f3be808e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:30.601090 25269 tablet_bootstrap.cc:492] T 9200e607002a41a390767e5f3be808e7 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:30.602595 25269 tablet_bootstrap.cc:654] T 9200e607002a41a390767e5f3be808e7 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:30.603935 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.013s user 0.005s sys 0.005s Metrics: {"bytes_written":329,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":63,"dirs.run_cpu_time_us":226,"dirs.run_wall_time_us":1369,"drs_written":1,"lbm_read_time_us":57,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1064,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":2,"update_count":1}
I20260807 18:14:30.604735 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.540230
I20260807 18:14:30.604847 25269 tablet_bootstrap.cc:492] T 9200e607002a41a390767e5f3be808e7 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:30.605026 25269 ts_tablet_manager.cc:1397] T 9200e607002a41a390767e5f3be808e7 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260807 18:14:30.605767 25269 raft_consensus.cc:348] T 9200e607002a41a390767e5f3be808e7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.605978 25269 raft_consensus.cc:374] T 9200e607002a41a390767e5f3be808e7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:30.606092 25269 raft_consensus.cc:729] T 9200e607002a41a390767e5f3be808e7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:30.606345 25269 consensus_queue.cc:260] T 9200e607002a41a390767e5f3be808e7 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.606531 25269 raft_consensus.cc:388] T 9200e607002a41a390767e5f3be808e7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:30.606629 25269 raft_consensus.cc:482] T 9200e607002a41a390767e5f3be808e7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:30.606724 25269 raft_consensus.cc:3037] T 9200e607002a41a390767e5f3be808e7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:30.608971 25269 raft_consensus.cc:504] T 9200e607002a41a390767e5f3be808e7 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.609218 25269 leader_election.cc:302] T 9200e607002a41a390767e5f3be808e7 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:30.609496 25269 leader_election.cc:288] T 9200e607002a41a390767e5f3be808e7 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:30.609597 25275 raft_consensus.cc:2781] T 9200e607002a41a390767e5f3be808e7 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:30.609831 25275 raft_consensus.cc:686] T 9200e607002a41a390767e5f3be808e7 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:30.610184 25269 ts_tablet_manager.cc:1428] T 9200e607002a41a390767e5f3be808e7 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 18:14:30.610106 25275 consensus_queue.cc:237] T 9200e607002a41a390767e5f3be808e7 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.613216 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.008s user 0.004s sys 0.005s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":459,"cfile_init":5,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":131,"lbm_read_time_us":376,"lbm_reads_lt_1ms":25,"lbm_write_time_us":378,"lbm_writes_lt_1ms":9,"mutex_wait_us":25,"reinsert_count":0,"spinlock_wait_cycles":5888,"update_count":1}
I20260807 18:14:30.614236 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 167 bytes on disk
I20260807 18:14:30.614230 24956 catalog_manager.cc:5495] T 9200e607002a41a390767e5f3be808e7 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:30.615028 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":99,"lbm_reads_lt_1ms":4}
I20260807 18:14:30.615840 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.216361
I20260807 18:14:30.643934 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.028s user 0.011s sys 0.016s Metrics: {"bytes_written":336,"cfile_cache_hit":13,"cfile_cache_hit_bytes":15181,"cfile_cache_miss":31,"cfile_cache_miss_bytes":22573,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":6,"dirs.queue_time_us":1007,"dirs.run_cpu_time_us":1111,"dirs.run_wall_time_us":6023,"drs_written":1,"lbm_read_time_us":1252,"lbm_reads_lt_1ms":63,"lbm_write_time_us":1180,"lbm_writes_lt_1ms":31,"mutex_wait_us":313,"num_input_rowsets":2,"peak_mem_usage":10444,"reinsert_count":0,"rows_written":77,"spinlock_wait_cycles":7936,"thread_start_us":490,"threads_started":1,"update_count":1}
I20260807 18:14:30.645228 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 3424 bytes on disk
I20260807 18:14:30.645987 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":111,"lbm_reads_lt_1ms":4}
I20260807 18:14:30.653560 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49538:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:30.666064 25147 tablet_service.cc:1467] Processing CreateTablet for tablet f4bbb69cd11a456ba6db419ff379fee3 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.38 [id=fa09f80c644946bd8e261f1e6515456d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:30.666637 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4bbb69cd11a456ba6db419ff379fee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:30.671551 25269 tablet_bootstrap.cc:492] T f4bbb69cd11a456ba6db419ff379fee3 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:30.672897 25269 tablet_bootstrap.cc:654] T f4bbb69cd11a456ba6db419ff379fee3 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:30.675323 25269 tablet_bootstrap.cc:492] T f4bbb69cd11a456ba6db419ff379fee3 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:30.675529 25269 ts_tablet_manager.cc:1397] T f4bbb69cd11a456ba6db419ff379fee3 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260807 18:14:30.676199 25269 raft_consensus.cc:348] T f4bbb69cd11a456ba6db419ff379fee3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.676391 25269 raft_consensus.cc:374] T f4bbb69cd11a456ba6db419ff379fee3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:30.676510 25269 raft_consensus.cc:729] T f4bbb69cd11a456ba6db419ff379fee3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:30.676802 25269 consensus_queue.cc:260] T f4bbb69cd11a456ba6db419ff379fee3 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.677021 25269 raft_consensus.cc:388] T f4bbb69cd11a456ba6db419ff379fee3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:30.677127 25269 raft_consensus.cc:482] T f4bbb69cd11a456ba6db419ff379fee3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:30.677246 25269 raft_consensus.cc:3037] T f4bbb69cd11a456ba6db419ff379fee3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:30.679322 25269 raft_consensus.cc:504] T f4bbb69cd11a456ba6db419ff379fee3 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.679577 25269 leader_election.cc:302] T f4bbb69cd11a456ba6db419ff379fee3 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:30.679775 25269 leader_election.cc:288] T f4bbb69cd11a456ba6db419ff379fee3 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:30.679970 25275 raft_consensus.cc:2781] T f4bbb69cd11a456ba6db419ff379fee3 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:30.680167 25275 raft_consensus.cc:686] T f4bbb69cd11a456ba6db419ff379fee3 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:30.680332 25269 ts_tablet_manager.cc:1428] T f4bbb69cd11a456ba6db419ff379fee3 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260807 18:14:30.680428 25275 consensus_queue.cc:237] T f4bbb69cd11a456ba6db419ff379fee3 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.684122 24957 catalog_manager.cc:5495] T f4bbb69cd11a456ba6db419ff379fee3 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:30.721911 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49554:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:30.734061 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 8f7dc00965944b5b83ef630ff541f925 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.39 [id=ddf6fc3d9aba46a3b19e6666e6510bb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:30.734522 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f7dc00965944b5b83ef630ff541f925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:30.739483 25269 tablet_bootstrap.cc:492] T 8f7dc00965944b5b83ef630ff541f925 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:30.740836 25269 tablet_bootstrap.cc:654] T 8f7dc00965944b5b83ef630ff541f925 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:30.743363 25269 tablet_bootstrap.cc:492] T 8f7dc00965944b5b83ef630ff541f925 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:30.743608 25269 ts_tablet_manager.cc:1397] T 8f7dc00965944b5b83ef630ff541f925 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260807 18:14:30.744223 25269 raft_consensus.cc:348] T 8f7dc00965944b5b83ef630ff541f925 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.744509 25269 raft_consensus.cc:374] T 8f7dc00965944b5b83ef630ff541f925 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:30.744608 25269 raft_consensus.cc:729] T 8f7dc00965944b5b83ef630ff541f925 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:30.744865 25269 consensus_queue.cc:260] T 8f7dc00965944b5b83ef630ff541f925 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.745054 25269 raft_consensus.cc:388] T 8f7dc00965944b5b83ef630ff541f925 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:30.745155 25269 raft_consensus.cc:482] T 8f7dc00965944b5b83ef630ff541f925 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:30.745249 25269 raft_consensus.cc:3037] T 8f7dc00965944b5b83ef630ff541f925 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:30.747437 25269 raft_consensus.cc:504] T 8f7dc00965944b5b83ef630ff541f925 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.747700 25269 leader_election.cc:302] T 8f7dc00965944b5b83ef630ff541f925 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:30.747916 25269 leader_election.cc:288] T 8f7dc00965944b5b83ef630ff541f925 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:30.748023 25275 raft_consensus.cc:2781] T 8f7dc00965944b5b83ef630ff541f925 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:30.748287 25275 raft_consensus.cc:686] T 8f7dc00965944b5b83ef630ff541f925 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:30.748441 25269 ts_tablet_manager.cc:1428] T 8f7dc00965944b5b83ef630ff541f925 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260807 18:14:30.748634 25275 consensus_queue.cc:237] T 8f7dc00965944b5b83ef630ff541f925 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.752498 24957 catalog_manager.cc:5495] T 8f7dc00965944b5b83ef630ff541f925 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:30.783763 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49568:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:30.796711 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 66516a438c4942e6aac9b149cff2cb4b (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.40 [id=c58cdbf35a2343a288f543e4068454ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:30.797343 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66516a438c4942e6aac9b149cff2cb4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:30.802803 25269 tablet_bootstrap.cc:492] T 66516a438c4942e6aac9b149cff2cb4b P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:30.804584 25269 tablet_bootstrap.cc:654] T 66516a438c4942e6aac9b149cff2cb4b P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:30.806811 25269 tablet_bootstrap.cc:492] T 66516a438c4942e6aac9b149cff2cb4b P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:30.806937 25269 ts_tablet_manager.cc:1397] T 66516a438c4942e6aac9b149cff2cb4b P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260807 18:14:30.807648 25269 raft_consensus.cc:348] T 66516a438c4942e6aac9b149cff2cb4b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.807878 25269 raft_consensus.cc:374] T 66516a438c4942e6aac9b149cff2cb4b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:30.807981 25269 raft_consensus.cc:729] T 66516a438c4942e6aac9b149cff2cb4b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:30.808256 25269 consensus_queue.cc:260] T 66516a438c4942e6aac9b149cff2cb4b P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.808444 25269 raft_consensus.cc:388] T 66516a438c4942e6aac9b149cff2cb4b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:30.808555 25269 raft_consensus.cc:482] T 66516a438c4942e6aac9b149cff2cb4b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:30.808692 25269 raft_consensus.cc:3037] T 66516a438c4942e6aac9b149cff2cb4b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:30.810643 25269 raft_consensus.cc:504] T 66516a438c4942e6aac9b149cff2cb4b P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.810858 25269 leader_election.cc:302] T 66516a438c4942e6aac9b149cff2cb4b P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:30.811038 25269 leader_election.cc:288] T 66516a438c4942e6aac9b149cff2cb4b P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:30.811138 25275 raft_consensus.cc:2781] T 66516a438c4942e6aac9b149cff2cb4b P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:30.811278 25275 raft_consensus.cc:686] T 66516a438c4942e6aac9b149cff2cb4b P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:30.811523 25275 consensus_queue.cc:237] T 66516a438c4942e6aac9b149cff2cb4b P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.811640 25269 ts_tablet_manager.cc:1428] T 66516a438c4942e6aac9b149cff2cb4b P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260807 18:14:30.813889 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000079
I20260807 18:14:30.815143 24956 catalog_manager.cc:5495] T 66516a438c4942e6aac9b149cff2cb4b P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:30.828338 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.014s user 0.010s sys 0.000s Metrics: {"bytes_written":336,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":46,"dirs.run_cpu_time_us":245,"dirs.run_wall_time_us":1349,"drs_written":1,"lbm_read_time_us":55,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1874,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":8,"update_count":1}
I20260807 18:14:30.829404 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.305912
I20260807 18:14:30.849270 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49584:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:30.853994 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.024s user 0.023s sys 0.001s Metrics: {"bytes_written":23602,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16275,"cfile_cache_miss":34,"cfile_cache_miss_bytes":25111,"cfile_init":10,"delta_iterators_relevant":8,"dirs.queue_time_us":959,"dirs.run_cpu_time_us":697,"dirs.run_wall_time_us":3690,"drs_written":1,"lbm_read_time_us":1315,"lbm_reads_lt_1ms":74,"lbm_write_time_us":758,"lbm_writes_lt_1ms":27,"mutex_wait_us":170,"num_input_rowsets":2,"peak_mem_usage":10492,"rows_written":83,"spinlock_wait_cycles":768,"thread_start_us":347,"threads_started":1}
I20260807 18:14:30.854804 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 3687 bytes on disk
I20260807 18:14:30.855443 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":87,"lbm_reads_lt_1ms":4}
I20260807 18:14:30.863555 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 3a6b6023c50e48409d2ae25a2f5283ef (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.41 [id=49a4909d1df24b39b0e089fdeb9bd70f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:30.864121 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a6b6023c50e48409d2ae25a2f5283ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:30.869056 25269 tablet_bootstrap.cc:492] T 3a6b6023c50e48409d2ae25a2f5283ef P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:30.870543 25269 tablet_bootstrap.cc:654] T 3a6b6023c50e48409d2ae25a2f5283ef P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:30.873189 25269 tablet_bootstrap.cc:492] T 3a6b6023c50e48409d2ae25a2f5283ef P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:30.873428 25269 ts_tablet_manager.cc:1397] T 3a6b6023c50e48409d2ae25a2f5283ef P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20260807 18:14:30.874075 25269 raft_consensus.cc:348] T 3a6b6023c50e48409d2ae25a2f5283ef P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.874292 25269 raft_consensus.cc:374] T 3a6b6023c50e48409d2ae25a2f5283ef P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:30.874390 25269 raft_consensus.cc:729] T 3a6b6023c50e48409d2ae25a2f5283ef P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:30.874672 25269 consensus_queue.cc:260] T 3a6b6023c50e48409d2ae25a2f5283ef P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.874848 25269 raft_consensus.cc:388] T 3a6b6023c50e48409d2ae25a2f5283ef P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:30.874951 25269 raft_consensus.cc:482] T 3a6b6023c50e48409d2ae25a2f5283ef P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:30.875054 25269 raft_consensus.cc:3037] T 3a6b6023c50e48409d2ae25a2f5283ef P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:30.877084 25269 raft_consensus.cc:504] T 3a6b6023c50e48409d2ae25a2f5283ef P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.877396 25269 leader_election.cc:302] T 3a6b6023c50e48409d2ae25a2f5283ef P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:30.877693 25269 leader_election.cc:288] T 3a6b6023c50e48409d2ae25a2f5283ef P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:30.877755 25275 raft_consensus.cc:2781] T 3a6b6023c50e48409d2ae25a2f5283ef P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:30.877951 25275 raft_consensus.cc:686] T 3a6b6023c50e48409d2ae25a2f5283ef P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:30.878193 25275 consensus_queue.cc:237] T 3a6b6023c50e48409d2ae25a2f5283ef P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.878541 25269 ts_tablet_manager.cc:1428] T 3a6b6023c50e48409d2ae25a2f5283ef P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
I20260807 18:14:30.882078 24956 catalog_manager.cc:5495] T 3a6b6023c50e48409d2ae25a2f5283ef P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:30.896977 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000081
I20260807 18:14:30.909574 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.004s sys 0.008s Metrics: {"bytes_written":6496,"cfile_init":1,"dirs.queue_time_us":84,"dirs.run_cpu_time_us":287,"dirs.run_wall_time_us":1501,"drs_written":1,"lbm_read_time_us":75,"lbm_reads_lt_1ms":4,"lbm_write_time_us":971,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":8}
I20260807 18:14:30.910797 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.292948
I20260807 18:14:30.925076 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49592:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.42"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:30.938222 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.027s user 0.026s sys 0.000s Metrics: {"bytes_written":24044,"cfile_cache_hit":13,"cfile_cache_hit_bytes":16652,"cfile_cache_miss":31,"cfile_cache_miss_bytes":25270,"cfile_init":9,"delta_iterators_relevant":6,"dirs.queue_time_us":531,"dirs.run_cpu_time_us":248,"dirs.run_wall_time_us":1392,"drs_written":1,"lbm_read_time_us":1555,"lbm_reads_lt_1ms":67,"lbm_write_time_us":1048,"lbm_writes_lt_1ms":27,"mutex_wait_us":51,"num_input_rowsets":2,"peak_mem_usage":10747,"rows_written":85,"spinlock_wait_cycles":896}
I20260807 18:14:30.939458 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 3765 bytes on disk
I20260807 18:14:30.939953 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 2bd8f6080b294bfcb084d6db5d06a430 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.42 [id=cea2313e51154238a2e033789cc13d7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:30.940128 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":95,"lbm_reads_lt_1ms":4}
I20260807 18:14:30.940405 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bd8f6080b294bfcb084d6db5d06a430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:30.940735 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000009
I20260807 18:14:30.947137 25269 tablet_bootstrap.cc:492] T 2bd8f6080b294bfcb084d6db5d06a430 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:30.948762 25269 tablet_bootstrap.cc:654] T 2bd8f6080b294bfcb084d6db5d06a430 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:30.951335 25269 tablet_bootstrap.cc:492] T 2bd8f6080b294bfcb084d6db5d06a430 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:30.951362 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.010s user 0.007s sys 0.001s Metrics: {"bytes_written":5157,"cfile_init":1,"dirs.queue_time_us":51,"dirs.run_cpu_time_us":193,"dirs.run_wall_time_us":1002,"drs_written":1,"lbm_read_time_us":93,"lbm_reads_lt_1ms":4,"lbm_write_time_us":659,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2,"spinlock_wait_cycles":4352}
I20260807 18:14:30.951719 25269 ts_tablet_manager.cc:1397] T 2bd8f6080b294bfcb084d6db5d06a430 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 18:14:30.952275 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.181024
I20260807 18:14:30.952557 25269 raft_consensus.cc:348] T 2bd8f6080b294bfcb084d6db5d06a430 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.952759 25269 raft_consensus.cc:374] T 2bd8f6080b294bfcb084d6db5d06a430 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:30.952891 25269 raft_consensus.cc:729] T 2bd8f6080b294bfcb084d6db5d06a430 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:30.953161 25269 consensus_queue.cc:260] T 2bd8f6080b294bfcb084d6db5d06a430 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.953402 25269 raft_consensus.cc:388] T 2bd8f6080b294bfcb084d6db5d06a430 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:30.953534 25269 raft_consensus.cc:482] T 2bd8f6080b294bfcb084d6db5d06a430 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:30.953677 25269 raft_consensus.cc:3037] T 2bd8f6080b294bfcb084d6db5d06a430 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:30.956038 25269 raft_consensus.cc:504] T 2bd8f6080b294bfcb084d6db5d06a430 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.956341 25269 leader_election.cc:302] T 2bd8f6080b294bfcb084d6db5d06a430 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:30.956691 25275 raft_consensus.cc:2781] T 2bd8f6080b294bfcb084d6db5d06a430 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:30.956831 25275 raft_consensus.cc:686] T 2bd8f6080b294bfcb084d6db5d06a430 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:30.957096 25275 consensus_queue.cc:237] T 2bd8f6080b294bfcb084d6db5d06a430 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:30.961077 25269 leader_election.cc:288] T 2bd8f6080b294bfcb084d6db5d06a430 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:30.961697 25269 ts_tablet_manager.cc:1428] T 2bd8f6080b294bfcb084d6db5d06a430 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.010s user 0.002s sys 0.003s
I20260807 18:14:30.961771 24956 catalog_manager.cc:5495] T 2bd8f6080b294bfcb084d6db5d06a430 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:30.979396 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.027s user 0.026s sys 0.000s Metrics: {"bytes_written":333,"cfile_cache_hit":12,"cfile_cache_hit_bytes":16998,"cfile_cache_miss":28,"cfile_cache_miss_bytes":25168,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":752,"dirs.run_cpu_time_us":193,"dirs.run_wall_time_us":1228,"drs_written":1,"lbm_read_time_us":1186,"lbm_reads_lt_1ms":60,"lbm_write_time_us":1252,"lbm_writes_lt_1ms":31,"mutex_wait_us":195,"num_input_rowsets":2,"peak_mem_usage":11719,"reinsert_count":0,"rows_written":87,"spinlock_wait_cycles":1664,"update_count":1}
I20260807 18:14:30.980516 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 3834 bytes on disk
I20260807 18:14:30.981221 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":80,"lbm_reads_lt_1ms":4}
I20260807 18:14:30.981822 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.000001
I20260807 18:14:30.986794 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.005s user 0.001s sys 0.002s Metrics: {"bytes_written":336,"delete_count":0,"lbm_write_time_us":142,"lbm_writes_lt_1ms":4,"reinsert_count":0,"update_count":1}
I20260807 18:14:30.987298 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260807 18:14:31.000036 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.005s sys 0.000s Metrics: {"cfile_cache_miss":4,"cfile_cache_miss_bytes":467,"cfile_init":1,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":87,"lbm_read_time_us":159,"lbm_reads_lt_1ms":8,"lbm_write_time_us":170,"lbm_writes_lt_1ms":4,"reinsert_count":0,"update_count":2}
I20260807 18:14:31.022655 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49606:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.43"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:31.035508 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 208cb77bd3ca4c6d917cf9846c52d5b4 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.43 [id=7cdae7cb55104b6686a105fa60ecffb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:31.036002 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 208cb77bd3ca4c6d917cf9846c52d5b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:31.040633 25269 tablet_bootstrap.cc:492] T 208cb77bd3ca4c6d917cf9846c52d5b4 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:31.042245 25269 tablet_bootstrap.cc:654] T 208cb77bd3ca4c6d917cf9846c52d5b4 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:31.044754 25269 tablet_bootstrap.cc:492] T 208cb77bd3ca4c6d917cf9846c52d5b4 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:31.044975 25269 ts_tablet_manager.cc:1397] T 208cb77bd3ca4c6d917cf9846c52d5b4 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260807 18:14:31.045900 25269 raft_consensus.cc:348] T 208cb77bd3ca4c6d917cf9846c52d5b4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.046123 25269 raft_consensus.cc:374] T 208cb77bd3ca4c6d917cf9846c52d5b4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:31.046244 25269 raft_consensus.cc:729] T 208cb77bd3ca4c6d917cf9846c52d5b4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:31.046489 25269 consensus_queue.cc:260] T 208cb77bd3ca4c6d917cf9846c52d5b4 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.046661 25269 raft_consensus.cc:388] T 208cb77bd3ca4c6d917cf9846c52d5b4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:31.046772 25269 raft_consensus.cc:482] T 208cb77bd3ca4c6d917cf9846c52d5b4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:31.046904 25269 raft_consensus.cc:3037] T 208cb77bd3ca4c6d917cf9846c52d5b4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:31.049522 25269 raft_consensus.cc:504] T 208cb77bd3ca4c6d917cf9846c52d5b4 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.049798 25269 leader_election.cc:302] T 208cb77bd3ca4c6d917cf9846c52d5b4 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:31.050042 25269 leader_election.cc:288] T 208cb77bd3ca4c6d917cf9846c52d5b4 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:31.050153 25275 raft_consensus.cc:2781] T 208cb77bd3ca4c6d917cf9846c52d5b4 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:31.050380 25275 raft_consensus.cc:686] T 208cb77bd3ca4c6d917cf9846c52d5b4 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:31.050594 25269 ts_tablet_manager.cc:1428] T 208cb77bd3ca4c6d917cf9846c52d5b4 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.001s sys 0.004s
I20260807 18:14:31.050722 25275 consensus_queue.cc:237] T 208cb77bd3ca4c6d917cf9846c52d5b4 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.055375 24957 catalog_manager.cc:5495] T 208cb77bd3ca4c6d917cf9846c52d5b4 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:31.093114 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49610:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:31.106014 25147 tablet_service.cc:1467] Processing CreateTablet for tablet cafe98ddc6054e71bee63246ca6753cf (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.44 [id=05ae6c9e35d3475d9c5fa54c9a9ae120]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:31.106423 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000077
I20260807 18:14:31.106560 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cafe98ddc6054e71bee63246ca6753cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:31.111852 25269 tablet_bootstrap.cc:492] T cafe98ddc6054e71bee63246ca6753cf P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:31.113240 25269 tablet_bootstrap.cc:654] T cafe98ddc6054e71bee63246ca6753cf P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:31.115893 25269 tablet_bootstrap.cc:492] T cafe98ddc6054e71bee63246ca6753cf P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:31.116017 25269 ts_tablet_manager.cc:1397] T cafe98ddc6054e71bee63246ca6753cf P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260807 18:14:31.116676 25269 raft_consensus.cc:348] T cafe98ddc6054e71bee63246ca6753cf P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.116842 25269 raft_consensus.cc:374] T cafe98ddc6054e71bee63246ca6753cf P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:31.116953 25269 raft_consensus.cc:729] T cafe98ddc6054e71bee63246ca6753cf P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:31.117228 25269 consensus_queue.cc:260] T cafe98ddc6054e71bee63246ca6753cf P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.117447 25269 raft_consensus.cc:388] T cafe98ddc6054e71bee63246ca6753cf P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:31.117555 25269 raft_consensus.cc:482] T cafe98ddc6054e71bee63246ca6753cf P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:31.117676 25269 raft_consensus.cc:3037] T cafe98ddc6054e71bee63246ca6753cf P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:31.117868 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.011s user 0.010s sys 0.000s Metrics: {"bytes_written":6458,"cfile_init":1,"dirs.queue_time_us":47,"dirs.run_cpu_time_us":233,"dirs.run_wall_time_us":1308,"drs_written":1,"lbm_read_time_us":60,"lbm_reads_lt_1ms":4,"lbm_write_time_us":801,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":8}
I20260807 18:14:31.118765 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.288444
I20260807 18:14:31.120146 25269 raft_consensus.cc:504] T cafe98ddc6054e71bee63246ca6753cf P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.120431 25269 leader_election.cc:302] T cafe98ddc6054e71bee63246ca6753cf P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:31.120652 25269 leader_election.cc:288] T cafe98ddc6054e71bee63246ca6753cf P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:31.120738 25275 raft_consensus.cc:2781] T cafe98ddc6054e71bee63246ca6753cf P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:31.120877 25275 raft_consensus.cc:686] T cafe98ddc6054e71bee63246ca6753cf P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:31.121197 25269 ts_tablet_manager.cc:1428] T cafe98ddc6054e71bee63246ca6753cf P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260807 18:14:31.121121 25275 consensus_queue.cc:237] T cafe98ddc6054e71bee63246ca6753cf P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.125715 24957 catalog_manager.cc:5495] T cafe98ddc6054e71bee63246ca6753cf P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:31.145951 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.027s user 0.025s sys 0.000s Metrics: {"bytes_written":336,"cfile_cache_hit":12,"cfile_cache_hit_bytes":17720,"cfile_cache_miss":28,"cfile_cache_miss_bytes":26478,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":811,"dirs.run_cpu_time_us":226,"dirs.run_wall_time_us":1186,"drs_written":1,"lbm_read_time_us":1253,"lbm_reads_lt_1ms":60,"lbm_write_time_us":1552,"lbm_writes_lt_1ms":31,"mutex_wait_us":24,"num_input_rowsets":2,"peak_mem_usage":11464,"reinsert_count":0,"rows_written":91,"spinlock_wait_cycles":768,"update_count":1}
I20260807 18:14:31.146984 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 4018 bytes on disk
I20260807 18:14:31.147601 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":97,"lbm_reads_lt_1ms":4}
I20260807 18:14:31.165668 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49624:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:31.177958 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 478fc471732d4dd09813a032539df0e9 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.45 [id=138263da44f34378b71dce891fc222a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:31.178434 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 478fc471732d4dd09813a032539df0e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:31.183347 25269 tablet_bootstrap.cc:492] T 478fc471732d4dd09813a032539df0e9 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:31.184701 25269 tablet_bootstrap.cc:654] T 478fc471732d4dd09813a032539df0e9 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:31.187336 25269 tablet_bootstrap.cc:492] T 478fc471732d4dd09813a032539df0e9 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:31.187536 25269 ts_tablet_manager.cc:1397] T 478fc471732d4dd09813a032539df0e9 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260807 18:14:31.188170 25269 raft_consensus.cc:348] T 478fc471732d4dd09813a032539df0e9 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.188383 25269 raft_consensus.cc:374] T 478fc471732d4dd09813a032539df0e9 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:31.188489 25269 raft_consensus.cc:729] T 478fc471732d4dd09813a032539df0e9 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:31.188736 25269 consensus_queue.cc:260] T 478fc471732d4dd09813a032539df0e9 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.188915 25269 raft_consensus.cc:388] T 478fc471732d4dd09813a032539df0e9 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:31.189054 25269 raft_consensus.cc:482] T 478fc471732d4dd09813a032539df0e9 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:31.189173 25269 raft_consensus.cc:3037] T 478fc471732d4dd09813a032539df0e9 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:31.191442 25269 raft_consensus.cc:504] T 478fc471732d4dd09813a032539df0e9 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.191704 25269 leader_election.cc:302] T 478fc471732d4dd09813a032539df0e9 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:31.191934 25269 leader_election.cc:288] T 478fc471732d4dd09813a032539df0e9 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:31.191993 25275 raft_consensus.cc:2781] T 478fc471732d4dd09813a032539df0e9 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:31.192222 25275 raft_consensus.cc:686] T 478fc471732d4dd09813a032539df0e9 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:31.192520 25269 ts_tablet_manager.cc:1428] T 478fc471732d4dd09813a032539df0e9 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260807 18:14:31.192485 25275 consensus_queue.cc:237] T 478fc471732d4dd09813a032539df0e9 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.196839 24957 catalog_manager.cc:5495] T 478fc471732d4dd09813a032539df0e9 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:31.226042 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49630:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:31.238343 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 3dbfb96858404a02ab58eab5ee52d44e (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.46 [id=e0f9c04a2a694731be4946f914d9f647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:31.238914 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dbfb96858404a02ab58eab5ee52d44e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:31.243588 25269 tablet_bootstrap.cc:492] T 3dbfb96858404a02ab58eab5ee52d44e P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:31.245208 25269 tablet_bootstrap.cc:654] T 3dbfb96858404a02ab58eab5ee52d44e P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:31.247591 25269 tablet_bootstrap.cc:492] T 3dbfb96858404a02ab58eab5ee52d44e P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:31.247771 25269 ts_tablet_manager.cc:1397] T 3dbfb96858404a02ab58eab5ee52d44e P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260807 18:14:31.248538 25269 raft_consensus.cc:348] T 3dbfb96858404a02ab58eab5ee52d44e P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.248747 25269 raft_consensus.cc:374] T 3dbfb96858404a02ab58eab5ee52d44e P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:31.248868 25269 raft_consensus.cc:729] T 3dbfb96858404a02ab58eab5ee52d44e P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:31.249100 25269 consensus_queue.cc:260] T 3dbfb96858404a02ab58eab5ee52d44e P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.249300 25269 raft_consensus.cc:388] T 3dbfb96858404a02ab58eab5ee52d44e P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:31.249420 25269 raft_consensus.cc:482] T 3dbfb96858404a02ab58eab5ee52d44e P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:31.249557 25269 raft_consensus.cc:3037] T 3dbfb96858404a02ab58eab5ee52d44e P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:31.251103 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000083
I20260807 18:14:31.252220 25269 raft_consensus.cc:504] T 3dbfb96858404a02ab58eab5ee52d44e P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.252511 25269 leader_election.cc:302] T 3dbfb96858404a02ab58eab5ee52d44e P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:31.252753 25269 leader_election.cc:288] T 3dbfb96858404a02ab58eab5ee52d44e P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:31.252874 25275 raft_consensus.cc:2781] T 3dbfb96858404a02ab58eab5ee52d44e P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:31.253057 25275 raft_consensus.cc:686] T 3dbfb96858404a02ab58eab5ee52d44e P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:31.253360 25269 ts_tablet_manager.cc:1428] T 3dbfb96858404a02ab58eab5ee52d44e P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260807 18:14:31.253415 25275 consensus_queue.cc:237] T 3dbfb96858404a02ab58eab5ee52d44e P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.258577 24956 catalog_manager.cc:5495] T 3dbfb96858404a02ab58eab5ee52d44e P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:31.269985 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.019s user 0.013s sys 0.000s Metrics: {"bytes_written":6459,"cfile_init":1,"dirs.queue_time_us":57,"dirs.run_cpu_time_us":204,"dirs.run_wall_time_us":1196,"drs_written":1,"lbm_read_time_us":88,"lbm_reads_lt_1ms":4,"lbm_write_time_us":931,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":8}
I20260807 18:14:31.271070 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 587 bytes on disk
I20260807 18:14:31.272029 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":101,"lbm_reads_lt_1ms":4}
I20260807 18:14:31.273053 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.283953
I20260807 18:14:31.296634 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.023s user 0.018s sys 0.004s Metrics: {"bytes_written":26222,"cfile_cache_hit":13,"cfile_cache_hit_bytes":18455,"cfile_cache_miss":31,"cfile_cache_miss_bytes":27971,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":626,"dirs.run_cpu_time_us":185,"dirs.run_wall_time_us":1333,"drs_written":1,"lbm_read_time_us":1057,"lbm_reads_lt_1ms":63,"lbm_write_time_us":733,"lbm_writes_lt_1ms":27,"mutex_wait_us":147,"num_input_rowsets":2,"peak_mem_usage":12225,"rows_written":95,"spinlock_wait_cycles":3584}
I20260807 18:14:31.297744 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 4193 bytes on disk
I20260807 18:14:31.298300 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":67,"lbm_reads_lt_1ms":4}
I20260807 18:14:31.299556 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49642:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.47"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:31.312304 25147 tablet_service.cc:1467] Processing CreateTablet for tablet ab826829a6c14158b1607f8981cbd123 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.47 [id=f21567ab3a2547ac92034b538eca146a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:31.312834 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab826829a6c14158b1607f8981cbd123. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:31.317797 25269 tablet_bootstrap.cc:492] T ab826829a6c14158b1607f8981cbd123 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:31.319164 25269 tablet_bootstrap.cc:654] T ab826829a6c14158b1607f8981cbd123 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:31.321550 25269 tablet_bootstrap.cc:492] T ab826829a6c14158b1607f8981cbd123 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:31.321727 25269 ts_tablet_manager.cc:1397] T ab826829a6c14158b1607f8981cbd123 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20260807 18:14:31.322331 25269 raft_consensus.cc:348] T ab826829a6c14158b1607f8981cbd123 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.322558 25269 raft_consensus.cc:374] T ab826829a6c14158b1607f8981cbd123 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:31.322647 25269 raft_consensus.cc:729] T ab826829a6c14158b1607f8981cbd123 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:31.322885 25269 consensus_queue.cc:260] T ab826829a6c14158b1607f8981cbd123 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.323074 25269 raft_consensus.cc:388] T ab826829a6c14158b1607f8981cbd123 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:31.323190 25269 raft_consensus.cc:482] T ab826829a6c14158b1607f8981cbd123 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:31.323302 25269 raft_consensus.cc:3037] T ab826829a6c14158b1607f8981cbd123 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:31.325265 25269 raft_consensus.cc:504] T ab826829a6c14158b1607f8981cbd123 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.325594 25269 leader_election.cc:302] T ab826829a6c14158b1607f8981cbd123 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:31.325811 25269 leader_election.cc:288] T ab826829a6c14158b1607f8981cbd123 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:31.325913 25275 raft_consensus.cc:2781] T ab826829a6c14158b1607f8981cbd123 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:31.326185 25275 raft_consensus.cc:686] T ab826829a6c14158b1607f8981cbd123 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:31.326414 25275 consensus_queue.cc:237] T ab826829a6c14158b1607f8981cbd123 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.326552 25269 ts_tablet_manager.cc:1428] T ab826829a6c14158b1607f8981cbd123 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.002s sys 0.002s
I20260807 18:14:31.330814 24956 catalog_manager.cc:5495] T ab826829a6c14158b1607f8981cbd123 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:31.367686 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49648:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:31.380759 25147 tablet_service.cc:1467] Processing CreateTablet for tablet db48567f2f42434cab81a0c64c648748 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.48 [id=f4e22bc2ffa1425e97e02cbc7eee7d37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:31.381316 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db48567f2f42434cab81a0c64c648748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:31.386078 25269 tablet_bootstrap.cc:492] T db48567f2f42434cab81a0c64c648748 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:31.387841 25269 tablet_bootstrap.cc:654] T db48567f2f42434cab81a0c64c648748 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:31.390789 25269 tablet_bootstrap.cc:492] T db48567f2f42434cab81a0c64c648748 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:31.390919 25269 ts_tablet_manager.cc:1397] T db48567f2f42434cab81a0c64c648748 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20260807 18:14:31.391660 25269 raft_consensus.cc:348] T db48567f2f42434cab81a0c64c648748 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.391834 25269 raft_consensus.cc:374] T db48567f2f42434cab81a0c64c648748 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:31.391952 25269 raft_consensus.cc:729] T db48567f2f42434cab81a0c64c648748 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:31.392238 25269 consensus_queue.cc:260] T db48567f2f42434cab81a0c64c648748 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.392490 25269 raft_consensus.cc:388] T db48567f2f42434cab81a0c64c648748 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:31.392618 25269 raft_consensus.cc:482] T db48567f2f42434cab81a0c64c648748 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:31.392738 25269 raft_consensus.cc:3037] T db48567f2f42434cab81a0c64c648748 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:31.394795 25269 raft_consensus.cc:504] T db48567f2f42434cab81a0c64c648748 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.395067 25269 leader_election.cc:302] T db48567f2f42434cab81a0c64c648748 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:31.395473 25269 leader_election.cc:288] T db48567f2f42434cab81a0c64c648748 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:31.395479 25275 raft_consensus.cc:2781] T db48567f2f42434cab81a0c64c648748 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:31.395748 25275 raft_consensus.cc:686] T db48567f2f42434cab81a0c64c648748 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:31.396092 25269 ts_tablet_manager.cc:1428] T db48567f2f42434cab81a0c64c648748 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.004s sys 0.001s
I20260807 18:14:31.396100 25275 consensus_queue.cc:237] T db48567f2f42434cab81a0c64c648748 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.398701 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000078
I20260807 18:14:31.402685 24957 catalog_manager.cc:5495] T db48567f2f42434cab81a0c64c648748 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:31.413120 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.014s user 0.006s sys 0.003s Metrics: {"bytes_written":6458,"cfile_init":1,"dirs.queue_time_us":65,"dirs.run_cpu_time_us":244,"dirs.run_wall_time_us":1318,"drs_written":1,"lbm_read_time_us":111,"lbm_reads_lt_1ms":4,"lbm_write_time_us":877,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":8}
I20260807 18:14:31.414062 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 584 bytes on disk
I20260807 18:14:31.414827 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":93,"lbm_reads_lt_1ms":4}
I20260807 18:14:31.415684 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.281376
I20260807 18:14:31.439711 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.024s user 0.022s sys 0.000s Metrics: {"bytes_written":27092,"cfile_cache_hit":13,"cfile_cache_hit_bytes":19193,"cfile_cache_miss":31,"cfile_cache_miss_bytes":28973,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":1156,"dirs.run_cpu_time_us":268,"dirs.run_wall_time_us":1342,"drs_written":1,"lbm_read_time_us":1023,"lbm_reads_lt_1ms":63,"lbm_write_time_us":768,"lbm_writes_lt_1ms":27,"mutex_wait_us":112,"num_input_rowsets":2,"peak_mem_usage":12741,"rows_written":99,"spinlock_wait_cycles":50048}
I20260807 18:14:31.440680 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 4356 bytes on disk
I20260807 18:14:31.441403 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":92,"lbm_reads_lt_1ms":4}
I20260807 18:14:31.445325 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49664:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:31.458081 25147 tablet_service.cc:1467] Processing CreateTablet for tablet ce8fae9bcc8e4cf4af264e61ccf4c97d (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.49 [id=327800b6b8294d799ba535739f16e88c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:31.458564 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce8fae9bcc8e4cf4af264e61ccf4c97d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:31.464682 25269 tablet_bootstrap.cc:492] T ce8fae9bcc8e4cf4af264e61ccf4c97d P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:31.466473 25269 tablet_bootstrap.cc:654] T ce8fae9bcc8e4cf4af264e61ccf4c97d P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:31.489980 25269 tablet_bootstrap.cc:492] T ce8fae9bcc8e4cf4af264e61ccf4c97d P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:31.490170 25269 ts_tablet_manager.cc:1397] T ce8fae9bcc8e4cf4af264e61ccf4c97d P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20260807 18:14:31.490907 25269 raft_consensus.cc:348] T ce8fae9bcc8e4cf4af264e61ccf4c97d P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.491099 25269 raft_consensus.cc:374] T ce8fae9bcc8e4cf4af264e61ccf4c97d P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:31.491158 25269 raft_consensus.cc:729] T ce8fae9bcc8e4cf4af264e61ccf4c97d P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:31.491408 25269 consensus_queue.cc:260] T ce8fae9bcc8e4cf4af264e61ccf4c97d P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.491570 25269 raft_consensus.cc:388] T ce8fae9bcc8e4cf4af264e61ccf4c97d P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:31.491642 25269 raft_consensus.cc:482] T ce8fae9bcc8e4cf4af264e61ccf4c97d P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:31.491711 25269 raft_consensus.cc:3037] T ce8fae9bcc8e4cf4af264e61ccf4c97d P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:31.493712 25269 raft_consensus.cc:504] T ce8fae9bcc8e4cf4af264e61ccf4c97d P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.493918 25269 leader_election.cc:302] T ce8fae9bcc8e4cf4af264e61ccf4c97d P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:31.494169 25269 leader_election.cc:288] T ce8fae9bcc8e4cf4af264e61ccf4c97d P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:31.494282 25275 raft_consensus.cc:2781] T ce8fae9bcc8e4cf4af264e61ccf4c97d P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:31.494536 25275 raft_consensus.cc:686] T ce8fae9bcc8e4cf4af264e61ccf4c97d P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:31.494714 25269 ts_tablet_manager.cc:1428] T ce8fae9bcc8e4cf4af264e61ccf4c97d P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260807 18:14:31.494771 25275 consensus_queue.cc:237] T ce8fae9bcc8e4cf4af264e61ccf4c97d P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.499017 24957 catalog_manager.cc:5495] T ce8fae9bcc8e4cf4af264e61ccf4c97d P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:31.531657 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49680:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:31.543720 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 9f7f81a141ee4ea9ae884536801409d3 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.50 [id=187e264fb5c74a4397094c08c10e5914]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:31.544353 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f7f81a141ee4ea9ae884536801409d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:31.549144 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000078
I20260807 18:14:31.553637 25269 tablet_bootstrap.cc:492] T 9f7f81a141ee4ea9ae884536801409d3 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:31.555361 25269 tablet_bootstrap.cc:654] T 9f7f81a141ee4ea9ae884536801409d3 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:31.558171 25269 tablet_bootstrap.cc:492] T 9f7f81a141ee4ea9ae884536801409d3 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:31.558328 25269 ts_tablet_manager.cc:1397] T 9f7f81a141ee4ea9ae884536801409d3 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20260807 18:14:31.559056 25269 raft_consensus.cc:348] T 9f7f81a141ee4ea9ae884536801409d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.559270 25269 raft_consensus.cc:374] T 9f7f81a141ee4ea9ae884536801409d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:31.559386 25269 raft_consensus.cc:729] T 9f7f81a141ee4ea9ae884536801409d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:31.559633 25269 consensus_queue.cc:260] T 9f7f81a141ee4ea9ae884536801409d3 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.559849 25269 raft_consensus.cc:388] T 9f7f81a141ee4ea9ae884536801409d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:31.559943 25269 raft_consensus.cc:482] T 9f7f81a141ee4ea9ae884536801409d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:31.560076 25269 raft_consensus.cc:3037] T 9f7f81a141ee4ea9ae884536801409d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:31.560392 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.011s user 0.008s sys 0.000s Metrics: {"bytes_written":6458,"cfile_init":1,"dirs.queue_time_us":121,"dirs.run_cpu_time_us":198,"dirs.run_wall_time_us":1120,"drs_written":1,"lbm_read_time_us":63,"lbm_reads_lt_1ms":4,"lbm_write_time_us":593,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":8}
I20260807 18:14:31.561322 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.279806
I20260807 18:14:31.562402 25269 raft_consensus.cc:504] T 9f7f81a141ee4ea9ae884536801409d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.562654 25269 leader_election.cc:302] T 9f7f81a141ee4ea9ae884536801409d3 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:31.562868 25269 leader_election.cc:288] T 9f7f81a141ee4ea9ae884536801409d3 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:31.563022 25275 raft_consensus.cc:2781] T 9f7f81a141ee4ea9ae884536801409d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:31.563215 25275 raft_consensus.cc:686] T 9f7f81a141ee4ea9ae884536801409d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:31.563381 25269 ts_tablet_manager.cc:1428] T 9f7f81a141ee4ea9ae884536801409d3 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 18:14:31.563498 25275 consensus_queue.cc:237] T 9f7f81a141ee4ea9ae884536801409d3 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.568491 24957 catalog_manager.cc:5495] T 9f7f81a141ee4ea9ae884536801409d3 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:31.594228 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.033s user 0.017s sys 0.010s Metrics: {"bytes_written":336,"cfile_cache_hit":12,"cfile_cache_hit_bytes":19934,"cfile_cache_miss":28,"cfile_cache_miss_bytes":29670,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":689,"dirs.run_cpu_time_us":193,"dirs.run_wall_time_us":1109,"drs_written":1,"lbm_read_time_us":1300,"lbm_reads_lt_1ms":60,"lbm_write_time_us":1344,"lbm_writes_lt_1ms":31,"mutex_wait_us":34,"num_input_rowsets":2,"peak_mem_usage":13198,"reinsert_count":0,"rows_written":103,"update_count":1}
I20260807 18:14:31.595424 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 4505 bytes on disk
I20260807 18:14:31.596122 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":81,"lbm_reads_lt_1ms":4}
I20260807 18:14:31.602002 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49682:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.51"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:31.614624 25147 tablet_service.cc:1467] Processing CreateTablet for tablet a7fc5d16f9bf444882cbd1a3daa980d3 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.51 [id=ca2d53ac8d2b44459b347918c2c05f02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:31.615208 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7fc5d16f9bf444882cbd1a3daa980d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:31.619889 25269 tablet_bootstrap.cc:492] T a7fc5d16f9bf444882cbd1a3daa980d3 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:31.621237 25269 tablet_bootstrap.cc:654] T a7fc5d16f9bf444882cbd1a3daa980d3 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:31.623423 25269 tablet_bootstrap.cc:492] T a7fc5d16f9bf444882cbd1a3daa980d3 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:31.623607 25269 ts_tablet_manager.cc:1397] T a7fc5d16f9bf444882cbd1a3daa980d3 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260807 18:14:31.624230 25269 raft_consensus.cc:348] T a7fc5d16f9bf444882cbd1a3daa980d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.624449 25269 raft_consensus.cc:374] T a7fc5d16f9bf444882cbd1a3daa980d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:31.624541 25269 raft_consensus.cc:729] T a7fc5d16f9bf444882cbd1a3daa980d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:31.624782 25269 consensus_queue.cc:260] T a7fc5d16f9bf444882cbd1a3daa980d3 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.624969 25269 raft_consensus.cc:388] T a7fc5d16f9bf444882cbd1a3daa980d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:31.625082 25269 raft_consensus.cc:482] T a7fc5d16f9bf444882cbd1a3daa980d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:31.625196 25269 raft_consensus.cc:3037] T a7fc5d16f9bf444882cbd1a3daa980d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:31.627070 25269 raft_consensus.cc:504] T a7fc5d16f9bf444882cbd1a3daa980d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.627316 25269 leader_election.cc:302] T a7fc5d16f9bf444882cbd1a3daa980d3 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:31.627537 25269 leader_election.cc:288] T a7fc5d16f9bf444882cbd1a3daa980d3 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:31.627584 25275 raft_consensus.cc:2781] T a7fc5d16f9bf444882cbd1a3daa980d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:31.627781 25275 raft_consensus.cc:686] T a7fc5d16f9bf444882cbd1a3daa980d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:31.628118 25269 ts_tablet_manager.cc:1428] T a7fc5d16f9bf444882cbd1a3daa980d3 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260807 18:14:31.628089 25275 consensus_queue.cc:237] T a7fc5d16f9bf444882cbd1a3daa980d3 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.632320 24957 catalog_manager.cc:5495] T a7fc5d16f9bf444882cbd1a3daa980d3 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:31.664119 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49696:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:31.676313 25147 tablet_service.cc:1467] Processing CreateTablet for tablet c1a913778b1547af9601db2fee26721c (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.52 [id=63658aab2f9d4346b7aa78c369594db1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:31.676777 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1a913778b1547af9601db2fee26721c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:31.682679 25269 tablet_bootstrap.cc:492] T c1a913778b1547af9601db2fee26721c P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:31.684264 25269 tablet_bootstrap.cc:654] T c1a913778b1547af9601db2fee26721c P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:31.687107 25269 tablet_bootstrap.cc:492] T c1a913778b1547af9601db2fee26721c P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:31.687258 25269 ts_tablet_manager.cc:1397] T c1a913778b1547af9601db2fee26721c P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260807 18:14:31.687912 25269 raft_consensus.cc:348] T c1a913778b1547af9601db2fee26721c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.688109 25269 raft_consensus.cc:374] T c1a913778b1547af9601db2fee26721c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:31.688295 25269 raft_consensus.cc:729] T c1a913778b1547af9601db2fee26721c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:31.688586 25269 consensus_queue.cc:260] T c1a913778b1547af9601db2fee26721c P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.688814 25269 raft_consensus.cc:388] T c1a913778b1547af9601db2fee26721c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:31.688907 25269 raft_consensus.cc:482] T c1a913778b1547af9601db2fee26721c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:31.689139 25269 raft_consensus.cc:3037] T c1a913778b1547af9601db2fee26721c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:31.691236 25269 raft_consensus.cc:504] T c1a913778b1547af9601db2fee26721c P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.691506 25269 leader_election.cc:302] T c1a913778b1547af9601db2fee26721c P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:31.691706 25269 leader_election.cc:288] T c1a913778b1547af9601db2fee26721c P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:31.691790 25275 raft_consensus.cc:2781] T c1a913778b1547af9601db2fee26721c P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:31.691931 25275 raft_consensus.cc:686] T c1a913778b1547af9601db2fee26721c P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:31.692210 25269 ts_tablet_manager.cc:1428] T c1a913778b1547af9601db2fee26721c P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260807 18:14:31.692180 25275 consensus_queue.cc:237] T c1a913778b1547af9601db2fee26721c P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.693980 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000078
I20260807 18:14:31.698885 24957 catalog_manager.cc:5495] T c1a913778b1547af9601db2fee26721c P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:31.718024 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.021s user 0.013s sys 0.002s Metrics: {"bytes_written":336,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":268,"dirs.run_cpu_time_us":186,"dirs.run_wall_time_us":1277,"drs_written":1,"lbm_read_time_us":60,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1783,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":8,"update_count":1}
I20260807 18:14:31.719570 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 588 bytes on disk
I20260807 18:14:31.720465 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":152,"lbm_reads_lt_1ms":4}
I20260807 18:14:31.722554 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.288233
I20260807 18:14:31.754555 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49712:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.53"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:31.759099 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.036s user 0.016s sys 0.019s Metrics: {"bytes_written":28850,"cfile_cache_hit":13,"cfile_cache_hit_bytes":20706,"cfile_cache_miss":31,"cfile_cache_miss_bytes":31170,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":2178,"dirs.run_cpu_time_us":1095,"dirs.run_wall_time_us":5487,"drs_written":1,"lbm_read_time_us":1202,"lbm_reads_lt_1ms":63,"lbm_write_time_us":1789,"lbm_writes_lt_1ms":27,"mutex_wait_us":25,"num_input_rowsets":2,"peak_mem_usage":13708,"rows_written":107,"spinlock_wait_cycles":56064,"thread_start_us":1306,"threads_started":1}
I20260807 18:14:31.760262 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 4682 bytes on disk
I20260807 18:14:31.761118 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":77,"lbm_reads_lt_1ms":4}
I20260807 18:14:31.769640 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 4984fdb388a04da5abc4fe14f165ff10 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.53 [id=82945786eaa64a27b14ed79341593a59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:31.770220 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4984fdb388a04da5abc4fe14f165ff10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:31.776142 25269 tablet_bootstrap.cc:492] T 4984fdb388a04da5abc4fe14f165ff10 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:31.778980 25269 tablet_bootstrap.cc:654] T 4984fdb388a04da5abc4fe14f165ff10 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:31.782979 25269 tablet_bootstrap.cc:492] T 4984fdb388a04da5abc4fe14f165ff10 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:31.783198 25269 ts_tablet_manager.cc:1397] T 4984fdb388a04da5abc4fe14f165ff10 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.005s
I20260807 18:14:31.784260 25269 raft_consensus.cc:348] T 4984fdb388a04da5abc4fe14f165ff10 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.784592 25269 raft_consensus.cc:374] T 4984fdb388a04da5abc4fe14f165ff10 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:31.784713 25269 raft_consensus.cc:729] T 4984fdb388a04da5abc4fe14f165ff10 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:31.785001 25269 consensus_queue.cc:260] T 4984fdb388a04da5abc4fe14f165ff10 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.785218 25269 raft_consensus.cc:388] T 4984fdb388a04da5abc4fe14f165ff10 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:31.785522 25269 raft_consensus.cc:482] T 4984fdb388a04da5abc4fe14f165ff10 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:31.785669 25269 raft_consensus.cc:3037] T 4984fdb388a04da5abc4fe14f165ff10 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:31.789016 25269 raft_consensus.cc:504] T 4984fdb388a04da5abc4fe14f165ff10 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.789307 25269 leader_election.cc:302] T 4984fdb388a04da5abc4fe14f165ff10 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:31.789769 25269 leader_election.cc:288] T 4984fdb388a04da5abc4fe14f165ff10 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:31.789770 25275 raft_consensus.cc:2781] T 4984fdb388a04da5abc4fe14f165ff10 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:31.790184 25275 raft_consensus.cc:686] T 4984fdb388a04da5abc4fe14f165ff10 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:31.790627 25269 ts_tablet_manager.cc:1428] T 4984fdb388a04da5abc4fe14f165ff10 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260807 18:14:31.790627 25275 consensus_queue.cc:237] T 4984fdb388a04da5abc4fe14f165ff10 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.797987 24956 catalog_manager.cc:5495] T 4984fdb388a04da5abc4fe14f165ff10 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:31.843859 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49718:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.54"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:31.847294 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000080
I20260807 18:14:31.858510 25147 tablet_service.cc:1467] Processing CreateTablet for tablet afd7c0571d6a44e6b9e33308cc4306bf (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.54 [id=82d2b9258325495dbe570e4813d03cc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:31.859067 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afd7c0571d6a44e6b9e33308cc4306bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:31.865039 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.017s user 0.009s sys 0.004s Metrics: {"bytes_written":6066,"cfile_init":1,"dirs.queue_time_us":47,"dirs.run_cpu_time_us":197,"dirs.run_wall_time_us":1381,"drs_written":1,"lbm_read_time_us":88,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1297,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:31.865988 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.259575
I20260807 18:14:31.866605 25269 tablet_bootstrap.cc:492] T afd7c0571d6a44e6b9e33308cc4306bf P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:31.869769 25269 tablet_bootstrap.cc:654] T afd7c0571d6a44e6b9e33308cc4306bf P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:31.874046 25269 tablet_bootstrap.cc:492] T afd7c0571d6a44e6b9e33308cc4306bf P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:31.874286 25269 ts_tablet_manager.cc:1397] T afd7c0571d6a44e6b9e33308cc4306bf P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.005s
I20260807 18:14:31.875283 25269 raft_consensus.cc:348] T afd7c0571d6a44e6b9e33308cc4306bf P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.875579 25269 raft_consensus.cc:374] T afd7c0571d6a44e6b9e33308cc4306bf P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:31.875761 25269 raft_consensus.cc:729] T afd7c0571d6a44e6b9e33308cc4306bf P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:31.876096 25269 consensus_queue.cc:260] T afd7c0571d6a44e6b9e33308cc4306bf P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.876422 25269 raft_consensus.cc:388] T afd7c0571d6a44e6b9e33308cc4306bf P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:31.876637 25269 raft_consensus.cc:482] T afd7c0571d6a44e6b9e33308cc4306bf P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:31.876874 25269 raft_consensus.cc:3037] T afd7c0571d6a44e6b9e33308cc4306bf P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:31.879895 25269 raft_consensus.cc:504] T afd7c0571d6a44e6b9e33308cc4306bf P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.880283 25269 leader_election.cc:302] T afd7c0571d6a44e6b9e33308cc4306bf P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:31.880616 25269 leader_election.cc:288] T afd7c0571d6a44e6b9e33308cc4306bf P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:31.880977 25275 raft_consensus.cc:2781] T afd7c0571d6a44e6b9e33308cc4306bf P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:31.881381 25275 raft_consensus.cc:686] T afd7c0571d6a44e6b9e33308cc4306bf P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:31.881731 25275 consensus_queue.cc:237] T afd7c0571d6a44e6b9e33308cc4306bf P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:31.882243 25269 ts_tablet_manager.cc:1428] T afd7c0571d6a44e6b9e33308cc4306bf P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20260807 18:14:31.888863 24956 catalog_manager.cc:5495] T afd7c0571d6a44e6b9e33308cc4306bf P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:31.903677 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.037s user 0.029s sys 0.008s Metrics: {"bytes_written":29290,"cfile_cache_hit":13,"cfile_cache_hit_bytes":21082,"cfile_cache_miss":31,"cfile_cache_miss_bytes":31718,"cfile_init":9,"delta_iterators_relevant":6,"dirs.queue_time_us":1052,"dirs.run_cpu_time_us":680,"dirs.run_wall_time_us":3215,"drs_written":1,"lbm_read_time_us":1312,"lbm_reads_lt_1ms":67,"lbm_write_time_us":1880,"lbm_writes_lt_1ms":27,"mutex_wait_us":192,"num_input_rowsets":2,"peak_mem_usage":14271,"rows_written":109}
I20260807 18:14:31.905035 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 4763 bytes on disk
I20260807 18:14:31.905903 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":89,"lbm_reads_lt_1ms":4}
I20260807 18:14:31.906759 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000012
I20260807 18:14:31.925899 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.019s user 0.017s sys 0.000s Metrics: {"bytes_written":334,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":37,"dirs.run_cpu_time_us":210,"dirs.run_wall_time_us":1324,"drs_written":1,"lbm_read_time_us":96,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1173,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":2,"update_count":1}
I20260807 18:14:31.927117 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 358 bytes on disk
I20260807 18:14:31.927816 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":85,"lbm_reads_lt_1ms":4}
I20260807 18:14:31.928567 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.441799
I20260807 18:14:31.942247 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.013s user 0.009s sys 0.003s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":611,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"lbm_read_time_us":429,"lbm_reads_lt_1ms":21,"lbm_write_time_us":410,"lbm_writes_lt_1ms":9,"reinsert_count":0,"update_count":1}
I20260807 18:14:31.943178 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.241717
I20260807 18:14:31.961114 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49728:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:31.981237 25147 tablet_service.cc:1467] Processing CreateTablet for tablet b967777c2fa44b058aae2af469bc986c (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.55 [id=7deddeb9c0b24c4b9577fb49111544b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:31.981969 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b967777c2fa44b058aae2af469bc986c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:31.995231 25269 tablet_bootstrap.cc:492] T b967777c2fa44b058aae2af469bc986c P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:31.994989 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.051s user 0.024s sys 0.023s Metrics: {"bytes_written":29717,"cfile_cache_hit":13,"cfile_cache_hit_bytes":21498,"cfile_cache_miss":31,"cfile_cache_miss_bytes":32328,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":2496,"dirs.run_cpu_time_us":1278,"dirs.run_wall_time_us":28086,"drs_written":1,"lbm_read_time_us":1515,"lbm_reads_lt_1ms":63,"lbm_write_time_us":1572,"lbm_writes_lt_1ms":27,"mutex_wait_us":88,"num_input_rowsets":2,"peak_mem_usage":14983,"rows_written":111,"thread_start_us":6729,"threads_started":1}
I20260807 18:14:31.998132 25269 tablet_bootstrap.cc:654] T b967777c2fa44b058aae2af469bc986c P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:31.998184 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 4854 bytes on disk
I20260807 18:14:31.999472 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":185,"lbm_reads_lt_1ms":4}
I20260807 18:14:32.000516 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000021
I20260807 18:14:32.012351 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000082
I20260807 18:14:32.013984 25269 tablet_bootstrap.cc:492] T b967777c2fa44b058aae2af469bc986c P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:32.014375 25269 ts_tablet_manager.cc:1397] T b967777c2fa44b058aae2af469bc986c P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.008s
I20260807 18:14:32.016012 25269 raft_consensus.cc:348] T b967777c2fa44b058aae2af469bc986c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.016352 25269 raft_consensus.cc:374] T b967777c2fa44b058aae2af469bc986c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:32.016528 25269 raft_consensus.cc:729] T b967777c2fa44b058aae2af469bc986c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:32.018147 25269 consensus_queue.cc:260] T b967777c2fa44b058aae2af469bc986c P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.018524 25269 raft_consensus.cc:388] T b967777c2fa44b058aae2af469bc986c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:32.018772 25269 raft_consensus.cc:482] T b967777c2fa44b058aae2af469bc986c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:32.018970 25269 raft_consensus.cc:3037] T b967777c2fa44b058aae2af469bc986c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:32.022377 25269 raft_consensus.cc:504] T b967777c2fa44b058aae2af469bc986c P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.022688 25269 leader_election.cc:302] T b967777c2fa44b058aae2af469bc986c P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:32.025097 25275 raft_consensus.cc:2781] T b967777c2fa44b058aae2af469bc986c P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:32.025449 25275 raft_consensus.cc:686] T b967777c2fa44b058aae2af469bc986c P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:32.025887 25275 consensus_queue.cc:237] T b967777c2fa44b058aae2af469bc986c P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.031093 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.030s user 0.011s sys 0.008s Metrics: {"bytes_written":5157,"cfile_init":1,"dirs.queue_time_us":56,"dirs.run_cpu_time_us":280,"dirs.run_wall_time_us":1854,"drs_written":1,"lbm_read_time_us":109,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1722,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2,"spinlock_wait_cycles":2304}
I20260807 18:14:32.032431 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 235 bytes on disk
I20260807 18:14:32.033177 25269 leader_election.cc:288] T b967777c2fa44b058aae2af469bc986c P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:32.034032 25269 ts_tablet_manager.cc:1428] T b967777c2fa44b058aae2af469bc986c P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.019s user 0.008s sys 0.001s
I20260807 18:14:32.035089 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":112,"lbm_reads_lt_1ms":4}
I20260807 18:14:32.036118 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.229385
I20260807 18:14:32.036006 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.023s user 0.008s sys 0.011s Metrics: {"bytes_written":6027,"cfile_init":1,"dirs.queue_time_us":83,"dirs.run_cpu_time_us":222,"dirs.run_wall_time_us":1356,"drs_written":1,"lbm_read_time_us":129,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1495,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:32.037204 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 535 bytes on disk
I20260807 18:14:32.038740 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":107,"lbm_reads_lt_1ms":4}
I20260807 18:14:32.039812 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.255955
I20260807 18:14:32.048472 24956 catalog_manager.cc:5495] T b967777c2fa44b058aae2af469bc986c P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:32.084046 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.044s user 0.037s sys 0.005s Metrics: {"bytes_written":30126,"cfile_cache_hit":12,"cfile_cache_hit_bytes":21786,"cfile_cache_miss":28,"cfile_cache_miss_bytes":32414,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":1454,"dirs.run_cpu_time_us":585,"dirs.run_wall_time_us":2660,"drs_written":1,"lbm_read_time_us":1401,"lbm_reads_lt_1ms":56,"lbm_write_time_us":1691,"lbm_writes_lt_1ms":27,"mutex_wait_us":468,"num_input_rowsets":2,"peak_mem_usage":14728,"rows_written":113,"spinlock_wait_cycles":4864}
I20260807 18:14:32.085207 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 4919 bytes on disk
I20260807 18:14:32.085969 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":97,"lbm_reads_lt_1ms":4}
I20260807 18:14:32.086869 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.000004
I20260807 18:14:32.094432 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.007s user 0.003s sys 0.003s Metrics: {"bytes_written":333,"delete_count":0,"lbm_write_time_us":240,"lbm_writes_lt_1ms":4,"reinsert_count":0,"update_count":1}
I20260807 18:14:32.095037 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.000002
I20260807 18:14:32.096637 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.060s user 0.029s sys 0.016s Metrics: {"bytes_written":333,"cfile_cache_hit":12,"cfile_cache_hit_bytes":21790,"cfile_cache_miss":28,"cfile_cache_miss_bytes":32168,"cfile_init":7,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":966,"dirs.run_cpu_time_us":206,"dirs.run_wall_time_us":1724,"drs_written":1,"lbm_read_time_us":1791,"lbm_reads_lt_1ms":56,"lbm_write_time_us":2118,"lbm_writes_lt_1ms":31,"mutex_wait_us":180,"num_input_rowsets":2,"peak_mem_usage":15442,"reinsert_count":0,"rows_written":113,"update_count":1}
I20260807 18:14:32.097692 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 4919 bytes on disk
I20260807 18:14:32.098335 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":80,"lbm_reads_lt_1ms":4}
I20260807 18:14:32.099027 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.000003
I20260807 18:14:32.100934 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.006s user 0.002s sys 0.000s Metrics: {"bytes_written":336,"delete_count":0,"lbm_write_time_us":162,"lbm_writes_lt_1ms":4,"reinsert_count":0,"update_count":1}
I20260807 18:14:32.101555 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260807 18:14:32.105078 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.006s user 0.002s sys 0.000s Metrics: {"bytes_written":336,"delete_count":0,"lbm_write_time_us":226,"lbm_writes_lt_1ms":4,"reinsert_count":0,"update_count":1}
I20260807 18:14:32.105720 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260807 18:14:32.111900 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.010s user 0.007s sys 0.000s Metrics: {"cfile_cache_miss":4,"cfile_cache_miss_bytes":467,"cfile_init":2,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":82,"lbm_read_time_us":164,"lbm_reads_lt_1ms":12,"lbm_write_time_us":214,"lbm_writes_lt_1ms":4,"reinsert_count":0,"update_count":2}
I20260807 18:14:32.113148 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.007s user 0.006s sys 0.001s Metrics: {"cfile_cache_miss":4,"cfile_cache_miss_bytes":467,"cfile_init":1,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":83,"lbm_read_time_us":112,"lbm_reads_lt_1ms":8,"lbm_write_time_us":159,"lbm_writes_lt_1ms":4,"reinsert_count":0,"update_count":2}
I20260807 18:14:32.132261 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49732:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:32.146380 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 364a63d2c4f74e1ba155ff2e06665fec (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.56 [id=85557216936741b8a19cf5a2c477d8a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:32.147056 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 364a63d2c4f74e1ba155ff2e06665fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:32.153759 25269 tablet_bootstrap.cc:492] T 364a63d2c4f74e1ba155ff2e06665fec P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:32.156347 25269 tablet_bootstrap.cc:654] T 364a63d2c4f74e1ba155ff2e06665fec P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:32.160259 25269 tablet_bootstrap.cc:492] T 364a63d2c4f74e1ba155ff2e06665fec P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:32.160499 25269 ts_tablet_manager.cc:1397] T 364a63d2c4f74e1ba155ff2e06665fec P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.003s
I20260807 18:14:32.161711 25269 raft_consensus.cc:348] T 364a63d2c4f74e1ba155ff2e06665fec P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.161947 25269 raft_consensus.cc:374] T 364a63d2c4f74e1ba155ff2e06665fec P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:32.162169 25269 raft_consensus.cc:729] T 364a63d2c4f74e1ba155ff2e06665fec P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:32.162695 25269 consensus_queue.cc:260] T 364a63d2c4f74e1ba155ff2e06665fec P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.163057 25269 raft_consensus.cc:388] T 364a63d2c4f74e1ba155ff2e06665fec P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:32.163257 25269 raft_consensus.cc:482] T 364a63d2c4f74e1ba155ff2e06665fec P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:32.163583 25269 raft_consensus.cc:3037] T 364a63d2c4f74e1ba155ff2e06665fec P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:32.167253 25269 raft_consensus.cc:504] T 364a63d2c4f74e1ba155ff2e06665fec P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.167800 25269 leader_election.cc:302] T 364a63d2c4f74e1ba155ff2e06665fec P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:32.168172 25269 leader_election.cc:288] T 364a63d2c4f74e1ba155ff2e06665fec P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:32.168507 25275 raft_consensus.cc:2781] T 364a63d2c4f74e1ba155ff2e06665fec P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:32.168956 25275 raft_consensus.cc:686] T 364a63d2c4f74e1ba155ff2e06665fec P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:32.169325 25269 ts_tablet_manager.cc:1428] T 364a63d2c4f74e1ba155ff2e06665fec P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260807 18:14:32.169556 25275 consensus_queue.cc:237] T 364a63d2c4f74e1ba155ff2e06665fec P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.187577 24957 catalog_manager.cc:5495] T 364a63d2c4f74e1ba155ff2e06665fec P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:32.226883 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49748:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.57"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:32.239904 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 0f852330f5ca476185783693d21398f4 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.57 [id=bfb76b23b968499c8c441d9e038087d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:32.240360 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f852330f5ca476185783693d21398f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:32.245524 25269 tablet_bootstrap.cc:492] T 0f852330f5ca476185783693d21398f4 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:32.248394 25269 tablet_bootstrap.cc:654] T 0f852330f5ca476185783693d21398f4 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:32.251588 25269 tablet_bootstrap.cc:492] T 0f852330f5ca476185783693d21398f4 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:32.251935 25269 ts_tablet_manager.cc:1397] T 0f852330f5ca476185783693d21398f4 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.002s
I20260807 18:14:32.253031 25269 raft_consensus.cc:348] T 0f852330f5ca476185783693d21398f4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.253455 25269 raft_consensus.cc:374] T 0f852330f5ca476185783693d21398f4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:32.253623 25269 raft_consensus.cc:729] T 0f852330f5ca476185783693d21398f4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:32.253963 25269 consensus_queue.cc:260] T 0f852330f5ca476185783693d21398f4 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.254240 25269 raft_consensus.cc:388] T 0f852330f5ca476185783693d21398f4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:32.254451 25269 raft_consensus.cc:482] T 0f852330f5ca476185783693d21398f4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:32.254611 25269 raft_consensus.cc:3037] T 0f852330f5ca476185783693d21398f4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:32.258318 25269 raft_consensus.cc:504] T 0f852330f5ca476185783693d21398f4 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.258769 25269 leader_election.cc:302] T 0f852330f5ca476185783693d21398f4 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:32.259179 25269 leader_election.cc:288] T 0f852330f5ca476185783693d21398f4 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:32.259186 25275 raft_consensus.cc:2781] T 0f852330f5ca476185783693d21398f4 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:32.259446 25275 raft_consensus.cc:686] T 0f852330f5ca476185783693d21398f4 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:32.259958 25275 consensus_queue.cc:237] T 0f852330f5ca476185783693d21398f4 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.260442 25269 ts_tablet_manager.cc:1428] T 0f852330f5ca476185783693d21398f4 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.008s user 0.005s sys 0.004s
I20260807 18:14:32.266162 24956 catalog_manager.cc:5495] T 0f852330f5ca476185783693d21398f4 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:32.303310 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49542:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:32.316448 25147 tablet_service.cc:1467] Processing CreateTablet for tablet e197a46ea7af4be3aa8f52f63d135f98 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.58 [id=837d4836de004a6cb496eed949cbd208]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:32.317030 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e197a46ea7af4be3aa8f52f63d135f98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:32.323822 25269 tablet_bootstrap.cc:492] T e197a46ea7af4be3aa8f52f63d135f98 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:32.326478 25269 tablet_bootstrap.cc:654] T e197a46ea7af4be3aa8f52f63d135f98 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:32.330248 25269 tablet_bootstrap.cc:492] T e197a46ea7af4be3aa8f52f63d135f98 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:32.330480 25269 ts_tablet_manager.cc:1397] T e197a46ea7af4be3aa8f52f63d135f98 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.004s
I20260807 18:14:32.331473 25269 raft_consensus.cc:348] T e197a46ea7af4be3aa8f52f63d135f98 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.331724 25269 raft_consensus.cc:374] T e197a46ea7af4be3aa8f52f63d135f98 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:32.331947 25269 raft_consensus.cc:729] T e197a46ea7af4be3aa8f52f63d135f98 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:32.332281 25269 consensus_queue.cc:260] T e197a46ea7af4be3aa8f52f63d135f98 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.332608 25269 raft_consensus.cc:388] T e197a46ea7af4be3aa8f52f63d135f98 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:32.332787 25269 raft_consensus.cc:482] T e197a46ea7af4be3aa8f52f63d135f98 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:32.333027 25269 raft_consensus.cc:3037] T e197a46ea7af4be3aa8f52f63d135f98 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:32.335776 25269 raft_consensus.cc:504] T e197a46ea7af4be3aa8f52f63d135f98 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.336220 25269 leader_election.cc:302] T e197a46ea7af4be3aa8f52f63d135f98 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:32.336496 25269 leader_election.cc:288] T e197a46ea7af4be3aa8f52f63d135f98 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:32.336679 25275 raft_consensus.cc:2781] T e197a46ea7af4be3aa8f52f63d135f98 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:32.336920 25275 raft_consensus.cc:686] T e197a46ea7af4be3aa8f52f63d135f98 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:32.337299 25275 consensus_queue.cc:237] T e197a46ea7af4be3aa8f52f63d135f98 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.337515 25269 ts_tablet_manager.cc:1428] T e197a46ea7af4be3aa8f52f63d135f98 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20260807 18:14:32.344129 24956 catalog_manager.cc:5495] T e197a46ea7af4be3aa8f52f63d135f98 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:32.363206 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000091
I20260807 18:14:32.364401 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000093
I20260807 18:14:32.380053 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.016s user 0.010s sys 0.004s Metrics: {"bytes_written":6065,"cfile_init":1,"dirs.queue_time_us":74,"dirs.run_cpu_time_us":259,"dirs.run_wall_time_us":1605,"drs_written":1,"lbm_read_time_us":66,"lbm_reads_lt_1ms":4,"lbm_write_time_us":934,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:32.381547 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 518 bytes on disk
I20260807 18:14:32.382615 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":138,"lbm_reads_lt_1ms":4}
I20260807 18:14:32.383673 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.255177
I20260807 18:14:32.387283 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.022s user 0.005s sys 0.014s Metrics: {"bytes_written":6065,"cfile_init":1,"dirs.queue_time_us":72,"dirs.run_cpu_time_us":205,"dirs.run_wall_time_us":1237,"drs_written":1,"lbm_read_time_us":98,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1363,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:32.388623 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 518 bytes on disk
I20260807 18:14:32.389734 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":162,"lbm_reads_lt_1ms":4}
I20260807 18:14:32.391070 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.255177
I20260807 18:14:32.407989 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49550:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:32.424175 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 34db036314324ec89c9dd38efb916f0a (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.59 [id=2ce4a98eff4e4c0ab5864d0d716881e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:32.424865 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34db036314324ec89c9dd38efb916f0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:32.431480 25269 tablet_bootstrap.cc:492] T 34db036314324ec89c9dd38efb916f0a P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:32.433758 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.042s user 0.013s sys 0.026s Metrics: {"bytes_written":31463,"cfile_cache_hit":13,"cfile_cache_hit_bytes":22932,"cfile_cache_miss":31,"cfile_cache_miss_bytes":34512,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":2318,"dirs.run_cpu_time_us":391,"dirs.run_wall_time_us":1911,"drs_written":1,"lbm_read_time_us":1551,"lbm_reads_lt_1ms":63,"lbm_write_time_us":1884,"lbm_writes_lt_1ms":27,"num_input_rowsets":2,"peak_mem_usage":16725,"rows_written":119,"spinlock_wait_cycles":1758080}
I20260807 18:14:32.434818 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 5203 bytes on disk
I20260807 18:14:32.435173 25269 tablet_bootstrap.cc:654] T 34db036314324ec89c9dd38efb916f0a P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:32.435652 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":103,"lbm_reads_lt_1ms":4}
I20260807 18:14:32.436537 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000014
I20260807 18:14:32.438140 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.054s user 0.036s sys 0.005s Metrics: {"bytes_written":31463,"cfile_cache_hit":13,"cfile_cache_hit_bytes":22932,"cfile_cache_miss":31,"cfile_cache_miss_bytes":34512,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":882,"dirs.run_cpu_time_us":1145,"dirs.run_wall_time_us":5449,"drs_written":1,"lbm_read_time_us":3566,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":62,"lbm_write_time_us":1959,"lbm_writes_lt_1ms":27,"mutex_wait_us":121,"num_input_rowsets":2,"peak_mem_usage":16725,"rows_written":119,"spinlock_wait_cycles":768,"thread_start_us":638,"threads_started":1}
I20260807 18:14:32.439500 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 5203 bytes on disk
I20260807 18:14:32.439821 25269 tablet_bootstrap.cc:492] T 34db036314324ec89c9dd38efb916f0a P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:32.440114 25269 ts_tablet_manager.cc:1397] T 34db036314324ec89c9dd38efb916f0a P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260807 18:14:32.440680 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":188,"lbm_reads_lt_1ms":4}
I20260807 18:14:32.441663 25269 raft_consensus.cc:348] T 34db036314324ec89c9dd38efb916f0a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.441845 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000017
I20260807 18:14:32.442162 25269 raft_consensus.cc:374] T 34db036314324ec89c9dd38efb916f0a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:32.442371 25269 raft_consensus.cc:729] T 34db036314324ec89c9dd38efb916f0a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:32.442849 25269 consensus_queue.cc:260] T 34db036314324ec89c9dd38efb916f0a P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.443154 25269 raft_consensus.cc:388] T 34db036314324ec89c9dd38efb916f0a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:32.443357 25269 raft_consensus.cc:482] T 34db036314324ec89c9dd38efb916f0a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:32.443565 25269 raft_consensus.cc:3037] T 34db036314324ec89c9dd38efb916f0a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:32.447290 25269 raft_consensus.cc:504] T 34db036314324ec89c9dd38efb916f0a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.447750 25269 leader_election.cc:302] T 34db036314324ec89c9dd38efb916f0a P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:32.448134 25275 raft_consensus.cc:2781] T 34db036314324ec89c9dd38efb916f0a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:32.448156 25269 leader_election.cc:288] T 34db036314324ec89c9dd38efb916f0a P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:32.448487 25275 raft_consensus.cc:686] T 34db036314324ec89c9dd38efb916f0a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:32.448832 25275 consensus_queue.cc:237] T 34db036314324ec89c9dd38efb916f0a P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.450207 25269 ts_tablet_manager.cc:1428] T 34db036314324ec89c9dd38efb916f0a P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.010s user 0.009s sys 0.001s
I20260807 18:14:32.461771 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.025s user 0.015s sys 0.005s Metrics: {"bytes_written":5157,"cfile_init":1,"dirs.queue_time_us":505,"dirs.run_cpu_time_us":204,"dirs.run_wall_time_us":1010,"drs_written":1,"lbm_read_time_us":96,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1680,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:32.461726 24956 catalog_manager.cc:5495] T 34db036314324ec89c9dd38efb916f0a P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:32.462553 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.020s user 0.007s sys 0.012s Metrics: {"bytes_written":5157,"cfile_init":1,"dirs.queue_time_us":81,"dirs.run_cpu_time_us":227,"dirs.run_wall_time_us":1093,"drs_written":1,"lbm_read_time_us":93,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1415,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:32.462993 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.202101
I20260807 18:14:32.463838 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.202101
I20260807 18:14:32.507594 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.043s user 0.036s sys 0.004s Metrics: {"bytes_written":389,"cfile_cache_hit":12,"cfile_cache_hit_bytes":23266,"cfile_cache_miss":28,"cfile_cache_miss_bytes":34342,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":603,"dirs.run_cpu_time_us":154,"dirs.run_wall_time_us":1435,"drs_written":1,"lbm_read_time_us":1448,"lbm_reads_lt_1ms":60,"lbm_write_time_us":1944,"lbm_writes_lt_1ms":31,"mutex_wait_us":75,"num_input_rowsets":2,"peak_mem_usage":16666,"reinsert_count":0,"rows_written":121,"spinlock_wait_cycles":2304,"update_count":2}
I20260807 18:14:32.508735 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 5273 bytes on disk
I20260807 18:14:32.509557 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":100,"lbm_reads_lt_1ms":4}
I20260807 18:14:32.512496 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.049s user 0.033s sys 0.008s Metrics: {"bytes_written":389,"cfile_cache_hit":12,"cfile_cache_hit_bytes":23266,"cfile_cache_miss":28,"cfile_cache_miss_bytes":34342,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":766,"dirs.run_cpu_time_us":195,"dirs.run_wall_time_us":1720,"drs_written":1,"lbm_read_time_us":1760,"lbm_reads_lt_1ms":60,"lbm_write_time_us":1875,"lbm_writes_lt_1ms":31,"mutex_wait_us":115,"num_input_rowsets":2,"peak_mem_usage":16666,"reinsert_count":0,"rows_written":121,"update_count":2}
I20260807 18:14:32.513738 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 5273 bytes on disk
I20260807 18:14:32.514644 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":187,"lbm_reads_lt_1ms":4}
I20260807 18:14:32.531657 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49562:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:32.547194 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 0450706cf759436ca1c7122742a5fa82 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.60 [id=d15527ef664f422799d8d44f9e8f0d36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:32.547930 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0450706cf759436ca1c7122742a5fa82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:32.555130 25269 tablet_bootstrap.cc:492] T 0450706cf759436ca1c7122742a5fa82 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:32.558136 25269 tablet_bootstrap.cc:654] T 0450706cf759436ca1c7122742a5fa82 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:32.561822 25269 tablet_bootstrap.cc:492] T 0450706cf759436ca1c7122742a5fa82 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:32.562158 25269 ts_tablet_manager.cc:1397] T 0450706cf759436ca1c7122742a5fa82 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.002s
I20260807 18:14:32.563400 25269 raft_consensus.cc:348] T 0450706cf759436ca1c7122742a5fa82 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.563691 25269 raft_consensus.cc:374] T 0450706cf759436ca1c7122742a5fa82 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:32.563931 25269 raft_consensus.cc:729] T 0450706cf759436ca1c7122742a5fa82 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:32.564329 25269 consensus_queue.cc:260] T 0450706cf759436ca1c7122742a5fa82 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.564666 25269 raft_consensus.cc:388] T 0450706cf759436ca1c7122742a5fa82 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:32.564841 25269 raft_consensus.cc:482] T 0450706cf759436ca1c7122742a5fa82 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:32.565100 25269 raft_consensus.cc:3037] T 0450706cf759436ca1c7122742a5fa82 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:32.568022 25269 raft_consensus.cc:504] T 0450706cf759436ca1c7122742a5fa82 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.568516 25269 leader_election.cc:302] T 0450706cf759436ca1c7122742a5fa82 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:32.568738 25269 leader_election.cc:288] T 0450706cf759436ca1c7122742a5fa82 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:32.569015 25275 raft_consensus.cc:2781] T 0450706cf759436ca1c7122742a5fa82 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:32.569239 25275 raft_consensus.cc:686] T 0450706cf759436ca1c7122742a5fa82 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:32.569397 25269 ts_tablet_manager.cc:1428] T 0450706cf759436ca1c7122742a5fa82 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.002s sys 0.003s
I20260807 18:14:32.569674 25275 consensus_queue.cc:237] T 0450706cf759436ca1c7122742a5fa82 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.576977 24956 catalog_manager.cc:5495] T 0450706cf759436ca1c7122742a5fa82 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:32.622851 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49574:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:32.636150 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 7680548e114347d48ea168381d56787b (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.61 [id=e3eebb8cc63241459120aa94e52632dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:32.636771 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7680548e114347d48ea168381d56787b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:32.643877 25269 tablet_bootstrap.cc:492] T 7680548e114347d48ea168381d56787b P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:32.647141 25269 tablet_bootstrap.cc:654] T 7680548e114347d48ea168381d56787b P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:32.651683 25269 tablet_bootstrap.cc:492] T 7680548e114347d48ea168381d56787b P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:32.651918 25269 ts_tablet_manager.cc:1397] T 7680548e114347d48ea168381d56787b P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260807 18:14:32.652962 25269 raft_consensus.cc:348] T 7680548e114347d48ea168381d56787b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.653491 25269 raft_consensus.cc:374] T 7680548e114347d48ea168381d56787b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:32.653721 25269 raft_consensus.cc:729] T 7680548e114347d48ea168381d56787b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:32.654217 25269 consensus_queue.cc:260] T 7680548e114347d48ea168381d56787b P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.654630 25269 raft_consensus.cc:388] T 7680548e114347d48ea168381d56787b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:32.654855 25269 raft_consensus.cc:482] T 7680548e114347d48ea168381d56787b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:32.655036 25269 raft_consensus.cc:3037] T 7680548e114347d48ea168381d56787b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:32.657867 25269 raft_consensus.cc:504] T 7680548e114347d48ea168381d56787b P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.658108 25269 leader_election.cc:302] T 7680548e114347d48ea168381d56787b P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:32.658471 25269 leader_election.cc:288] T 7680548e114347d48ea168381d56787b P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:32.658500 25275 raft_consensus.cc:2781] T 7680548e114347d48ea168381d56787b P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:32.659051 25275 raft_consensus.cc:686] T 7680548e114347d48ea168381d56787b P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:32.659358 25269 ts_tablet_manager.cc:1428] T 7680548e114347d48ea168381d56787b P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.001s sys 0.005s
I20260807 18:14:32.659420 25275 consensus_queue.cc:237] T 7680548e114347d48ea168381d56787b P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.665639 24956 catalog_manager.cc:5495] T 7680548e114347d48ea168381d56787b P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:32.709547 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49578:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.62"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:32.724098 25147 tablet_service.cc:1467] Processing CreateTablet for tablet e0659f9a87c64521bb904a910296a901 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.62 [id=62d78f0f36f84c5e8e874e91411e63f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:32.724798 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0659f9a87c64521bb904a910296a901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:32.732759 25269 tablet_bootstrap.cc:492] T e0659f9a87c64521bb904a910296a901 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:32.735311 25269 tablet_bootstrap.cc:654] T e0659f9a87c64521bb904a910296a901 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:32.738987 25269 tablet_bootstrap.cc:492] T e0659f9a87c64521bb904a910296a901 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:32.739259 25269 ts_tablet_manager.cc:1397] T e0659f9a87c64521bb904a910296a901 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260807 18:14:32.740370 25269 raft_consensus.cc:348] T e0659f9a87c64521bb904a910296a901 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.740720 25269 raft_consensus.cc:374] T e0659f9a87c64521bb904a910296a901 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:32.740970 25269 raft_consensus.cc:729] T e0659f9a87c64521bb904a910296a901 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:32.741410 25269 consensus_queue.cc:260] T e0659f9a87c64521bb904a910296a901 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.741820 25269 raft_consensus.cc:388] T e0659f9a87c64521bb904a910296a901 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:32.741978 25269 raft_consensus.cc:482] T e0659f9a87c64521bb904a910296a901 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:32.742246 25269 raft_consensus.cc:3037] T e0659f9a87c64521bb904a910296a901 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:32.745071 25269 raft_consensus.cc:504] T e0659f9a87c64521bb904a910296a901 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.745492 25269 leader_election.cc:302] T e0659f9a87c64521bb904a910296a901 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:32.745872 25269 leader_election.cc:288] T e0659f9a87c64521bb904a910296a901 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:32.746047 25275 raft_consensus.cc:2781] T e0659f9a87c64521bb904a910296a901 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:32.746313 25275 raft_consensus.cc:686] T e0659f9a87c64521bb904a910296a901 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:32.746829 25275 consensus_queue.cc:237] T e0659f9a87c64521bb904a910296a901 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.748454 25269 ts_tablet_manager.cc:1428] T e0659f9a87c64521bb904a910296a901 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.000s sys 0.007s
I20260807 18:14:32.754137 24956 catalog_manager.cc:5495] T e0659f9a87c64521bb904a910296a901 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:32.760824 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000083
I20260807 18:14:32.765801 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000084
I20260807 18:14:32.777168 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.016s user 0.003s sys 0.009s Metrics: {"bytes_written":6066,"cfile_init":1,"dirs.queue_time_us":55,"dirs.run_cpu_time_us":254,"dirs.run_wall_time_us":1359,"drs_written":1,"lbm_read_time_us":107,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1042,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:32.778059 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.253417
I20260807 18:14:32.778324 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.011s sys 0.000s Metrics: {"bytes_written":6066,"cfile_init":1,"dirs.queue_time_us":63,"dirs.run_cpu_time_us":197,"dirs.run_wall_time_us":1093,"drs_written":1,"lbm_read_time_us":90,"lbm_reads_lt_1ms":4,"lbm_write_time_us":842,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:32.779291 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.253417
I20260807 18:14:32.810119 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.032s user 0.031s sys 0.000s Metrics: {"bytes_written":33232,"cfile_cache_hit":13,"cfile_cache_hit_bytes":24408,"cfile_cache_miss":31,"cfile_cache_miss_bytes":36702,"cfile_init":9,"delta_iterators_relevant":6,"dirs.queue_time_us":574,"dirs.run_cpu_time_us":252,"dirs.run_wall_time_us":1314,"drs_written":1,"lbm_read_time_us":1343,"lbm_reads_lt_1ms":67,"lbm_write_time_us":1262,"lbm_writes_lt_1ms":28,"mutex_wait_us":50,"num_input_rowsets":2,"peak_mem_usage":17949,"rows_written":127,"spinlock_wait_cycles":6016}
I20260807 18:14:32.811297 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 5553 bytes on disk
I20260807 18:14:32.811972 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":114,"lbm_reads_lt_1ms":4}
I20260807 18:14:32.821959 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49580:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:32.835045 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.041s user 0.031s sys 0.005s Metrics: {"bytes_written":33232,"cfile_cache_hit":13,"cfile_cache_hit_bytes":24408,"cfile_cache_miss":31,"cfile_cache_miss_bytes":36702,"cfile_init":9,"delta_iterators_relevant":6,"dirs.queue_time_us":577,"dirs.run_cpu_time_us":197,"dirs.run_wall_time_us":1144,"drs_written":1,"lbm_read_time_us":1641,"lbm_reads_lt_1ms":67,"lbm_write_time_us":1165,"lbm_writes_lt_1ms":28,"mutex_wait_us":11,"num_input_rowsets":2,"peak_mem_usage":17949,"rows_written":127,"spinlock_wait_cycles":18688}
I20260807 18:14:32.836943 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 5553 bytes on disk
I20260807 18:14:32.837941 25147 tablet_service.cc:1467] Processing CreateTablet for tablet df031f58203c44b59cd791a5fe0cb23c (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.63 [id=f51b764975724ace81ea4383b27bcc45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:32.838549 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df031f58203c44b59cd791a5fe0cb23c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:32.837890 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":94,"lbm_reads_lt_1ms":4}
I20260807 18:14:32.839152 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000017
I20260807 18:14:32.848955 25269 tablet_bootstrap.cc:492] T df031f58203c44b59cd791a5fe0cb23c P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:32.851182 25269 tablet_bootstrap.cc:654] T df031f58203c44b59cd791a5fe0cb23c P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:32.854128 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.015s user 0.013s sys 0.001s Metrics: {"bytes_written":5157,"cfile_init":1,"dirs.queue_time_us":102,"dirs.run_cpu_time_us":173,"dirs.run_wall_time_us":1236,"drs_written":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4,"lbm_write_time_us":725,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:32.855305 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.199018
I20260807 18:14:32.855628 25269 tablet_bootstrap.cc:492] T df031f58203c44b59cd791a5fe0cb23c P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:32.855829 25269 ts_tablet_manager.cc:1397] T df031f58203c44b59cd791a5fe0cb23c P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 18:14:32.856958 25269 raft_consensus.cc:348] T df031f58203c44b59cd791a5fe0cb23c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.857280 25269 raft_consensus.cc:374] T df031f58203c44b59cd791a5fe0cb23c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:32.857481 25269 raft_consensus.cc:729] T df031f58203c44b59cd791a5fe0cb23c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:32.857829 25269 consensus_queue.cc:260] T df031f58203c44b59cd791a5fe0cb23c P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.858134 25269 raft_consensus.cc:388] T df031f58203c44b59cd791a5fe0cb23c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:32.858345 25269 raft_consensus.cc:482] T df031f58203c44b59cd791a5fe0cb23c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:32.858544 25269 raft_consensus.cc:3037] T df031f58203c44b59cd791a5fe0cb23c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:32.861208 25269 raft_consensus.cc:504] T df031f58203c44b59cd791a5fe0cb23c P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.861572 25269 leader_election.cc:302] T df031f58203c44b59cd791a5fe0cb23c P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:32.861871 25275 raft_consensus.cc:2781] T df031f58203c44b59cd791a5fe0cb23c P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:32.862106 25275 raft_consensus.cc:686] T df031f58203c44b59cd791a5fe0cb23c P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:32.862520 25275 consensus_queue.cc:237] T df031f58203c44b59cd791a5fe0cb23c P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.866353 25269 leader_election.cc:288] T df031f58203c44b59cd791a5fe0cb23c P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:32.867201 25269 ts_tablet_manager.cc:1428] T df031f58203c44b59cd791a5fe0cb23c P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.011s user 0.005s sys 0.002s
I20260807 18:14:32.869578 24956 catalog_manager.cc:5495] T df031f58203c44b59cd791a5fe0cb23c P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:32.895082 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.039s user 0.033s sys 0.004s Metrics: {"bytes_written":389,"cfile_cache_hit":12,"cfile_cache_hit_bytes":24742,"cfile_cache_miss":28,"cfile_cache_miss_bytes":36524,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":816,"dirs.run_cpu_time_us":243,"dirs.run_wall_time_us":1460,"drs_written":1,"lbm_read_time_us":1581,"lbm_reads_lt_1ms":60,"lbm_write_time_us":1556,"lbm_writes_lt_1ms":32,"mutex_wait_us":160,"num_input_rowsets":2,"peak_mem_usage":17989,"reinsert_count":0,"rows_written":129,"spinlock_wait_cycles":4352,"update_count":2}
I20260807 18:14:32.896095 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 5618 bytes on disk
I20260807 18:14:32.896914 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":120,"lbm_reads_lt_1ms":4}
I20260807 18:14:32.927871 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49592:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.64"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:32.940894 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 08021c24022647659a4cbb434582b36a (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.64 [id=a8c0a079cce440d5bab4e3b6bc0235ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:32.941591 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08021c24022647659a4cbb434582b36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:32.948882 25269 tablet_bootstrap.cc:492] T 08021c24022647659a4cbb434582b36a P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:32.952147 25269 tablet_bootstrap.cc:654] T 08021c24022647659a4cbb434582b36a P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:32.956444 25269 tablet_bootstrap.cc:492] T 08021c24022647659a4cbb434582b36a P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:32.956796 25269 ts_tablet_manager.cc:1397] T 08021c24022647659a4cbb434582b36a P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260807 18:14:32.958174 25269 raft_consensus.cc:348] T 08021c24022647659a4cbb434582b36a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.958397 25269 raft_consensus.cc:374] T 08021c24022647659a4cbb434582b36a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:32.958568 25269 raft_consensus.cc:729] T 08021c24022647659a4cbb434582b36a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:32.958925 25269 consensus_queue.cc:260] T 08021c24022647659a4cbb434582b36a P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.959197 25269 raft_consensus.cc:388] T 08021c24022647659a4cbb434582b36a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:32.959348 25269 raft_consensus.cc:482] T 08021c24022647659a4cbb434582b36a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:32.959654 25269 raft_consensus.cc:3037] T 08021c24022647659a4cbb434582b36a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:32.963492 25269 raft_consensus.cc:504] T 08021c24022647659a4cbb434582b36a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.963866 25269 leader_election.cc:302] T 08021c24022647659a4cbb434582b36a P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:32.964138 25269 leader_election.cc:288] T 08021c24022647659a4cbb434582b36a P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:32.964427 25275 raft_consensus.cc:2781] T 08021c24022647659a4cbb434582b36a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:32.964689 25275 raft_consensus.cc:686] T 08021c24022647659a4cbb434582b36a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:32.964861 25269 ts_tablet_manager.cc:1428] T 08021c24022647659a4cbb434582b36a P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.008s user 0.002s sys 0.004s
I20260807 18:14:32.965093 25275 consensus_queue.cc:237] T 08021c24022647659a4cbb434582b36a P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:32.984541 24956 catalog_manager.cc:5495] T 08021c24022647659a4cbb434582b36a P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:33.039742 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49594:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.65"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:33.053203 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 9d3fceeb18b042a69c6995dec37823a7 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.65 [id=d97e69959dfe4d799634dc8b235e1399]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:33.053815 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d3fceeb18b042a69c6995dec37823a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:33.060310 25269 tablet_bootstrap.cc:492] T 9d3fceeb18b042a69c6995dec37823a7 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:33.062865 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000079
I20260807 18:14:33.063685 25269 tablet_bootstrap.cc:654] T 9d3fceeb18b042a69c6995dec37823a7 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:33.067581 25269 tablet_bootstrap.cc:492] T 9d3fceeb18b042a69c6995dec37823a7 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:33.067804 25269 ts_tablet_manager.cc:1397] T 9d3fceeb18b042a69c6995dec37823a7 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.005s
I20260807 18:14:33.068600 25269 raft_consensus.cc:348] T 9d3fceeb18b042a69c6995dec37823a7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.068861 25269 raft_consensus.cc:374] T 9d3fceeb18b042a69c6995dec37823a7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:33.068956 25269 raft_consensus.cc:729] T 9d3fceeb18b042a69c6995dec37823a7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:33.069278 25269 consensus_queue.cc:260] T 9d3fceeb18b042a69c6995dec37823a7 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.069638 25269 raft_consensus.cc:388] T 9d3fceeb18b042a69c6995dec37823a7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:33.069821 25269 raft_consensus.cc:482] T 9d3fceeb18b042a69c6995dec37823a7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:33.069965 25269 raft_consensus.cc:3037] T 9d3fceeb18b042a69c6995dec37823a7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:33.072953 25269 raft_consensus.cc:504] T 9d3fceeb18b042a69c6995dec37823a7 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.073174 25269 leader_election.cc:302] T 9d3fceeb18b042a69c6995dec37823a7 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:33.073426 25269 leader_election.cc:288] T 9d3fceeb18b042a69c6995dec37823a7 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:33.073547 25275 raft_consensus.cc:2781] T 9d3fceeb18b042a69c6995dec37823a7 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:33.073833 25275 raft_consensus.cc:686] T 9d3fceeb18b042a69c6995dec37823a7 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:33.074050 25269 ts_tablet_manager.cc:1428] T 9d3fceeb18b042a69c6995dec37823a7 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260807 18:14:33.074194 25275 consensus_queue.cc:237] T 9d3fceeb18b042a69c6995dec37823a7 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.080811 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.018s user 0.003s sys 0.012s Metrics: {"bytes_written":6029,"cfile_init":1,"dirs.queue_time_us":59,"dirs.run_cpu_time_us":229,"dirs.run_wall_time_us":1326,"drs_written":1,"lbm_read_time_us":81,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1119,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6,"spinlock_wait_cycles":2944}
I20260807 18:14:33.081259 24956 catalog_manager.cc:5495] T 9d3fceeb18b042a69c6995dec37823a7 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:33.082429 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 535 bytes on disk
I20260807 18:14:33.084121 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":110,"lbm_reads_lt_1ms":4}
I20260807 18:14:33.085760 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.224911
I20260807 18:14:33.124871 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.039s user 0.021s sys 0.017s Metrics: {"bytes_written":336,"cfile_cache_hit":12,"cfile_cache_hit_bytes":25476,"cfile_cache_miss":28,"cfile_cache_miss_bytes":37854,"cfile_init":7,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":1011,"dirs.run_cpu_time_us":230,"dirs.run_wall_time_us":1586,"drs_written":1,"lbm_read_time_us":1815,"lbm_reads_lt_1ms":56,"lbm_write_time_us":1414,"lbm_writes_lt_1ms":32,"mutex_wait_us":208,"num_input_rowsets":2,"peak_mem_usage":18701,"reinsert_count":0,"rows_written":133,"update_count":1}
I20260807 18:14:33.127112 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 5811 bytes on disk
I20260807 18:14:33.127974 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":99,"lbm_reads_lt_1ms":4}
I20260807 18:14:33.132009 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49602:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.66"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:33.145937 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 3d91f2cadaec47a0b2f6f594c171b9f5 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.66 [id=ae5522a9c9ef45549bdc64f4a12ae939]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:33.146729 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d91f2cadaec47a0b2f6f594c171b9f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:33.147958 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000082
I20260807 18:14:33.157070 25269 tablet_bootstrap.cc:492] T 3d91f2cadaec47a0b2f6f594c171b9f5 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:33.159861 25269 tablet_bootstrap.cc:654] T 3d91f2cadaec47a0b2f6f594c171b9f5 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:33.164448 25269 tablet_bootstrap.cc:492] T 3d91f2cadaec47a0b2f6f594c171b9f5 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:33.164853 25269 ts_tablet_manager.cc:1397] T 3d91f2cadaec47a0b2f6f594c171b9f5 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260807 18:14:33.165903 25269 raft_consensus.cc:348] T 3d91f2cadaec47a0b2f6f594c171b9f5 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.166106 25269 raft_consensus.cc:374] T 3d91f2cadaec47a0b2f6f594c171b9f5 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:33.166280 25269 raft_consensus.cc:729] T 3d91f2cadaec47a0b2f6f594c171b9f5 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:33.166114 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.018s user 0.004s sys 0.012s Metrics: {"bytes_written":6028,"cfile_init":1,"dirs.queue_time_us":88,"dirs.run_cpu_time_us":314,"dirs.run_wall_time_us":1413,"drs_written":1,"lbm_read_time_us":49,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1458,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:33.166558 25269 consensus_queue.cc:260] T 3d91f2cadaec47a0b2f6f594c171b9f5 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.166819 25269 raft_consensus.cc:388] T 3d91f2cadaec47a0b2f6f594c171b9f5 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:33.166939 25269 raft_consensus.cc:482] T 3d91f2cadaec47a0b2f6f594c171b9f5 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:33.167115 25269 raft_consensus.cc:3037] T 3d91f2cadaec47a0b2f6f594c171b9f5 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:33.167470 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 503 bytes on disk
I20260807 18:14:33.168828 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":108,"lbm_reads_lt_1ms":4}
I20260807 18:14:33.170053 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.198026
I20260807 18:14:33.170874 25269 raft_consensus.cc:504] T 3d91f2cadaec47a0b2f6f594c171b9f5 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.171211 25269 leader_election.cc:302] T 3d91f2cadaec47a0b2f6f594c171b9f5 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:33.171469 25269 leader_election.cc:288] T 3d91f2cadaec47a0b2f6f594c171b9f5 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:33.171757 25275 raft_consensus.cc:2781] T 3d91f2cadaec47a0b2f6f594c171b9f5 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:33.171991 25275 raft_consensus.cc:686] T 3d91f2cadaec47a0b2f6f594c171b9f5 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:33.172180 25269 ts_tablet_manager.cc:1428] T 3d91f2cadaec47a0b2f6f594c171b9f5 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 18:14:33.172381 25275 consensus_queue.cc:237] T 3d91f2cadaec47a0b2f6f594c171b9f5 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.180480 24957 catalog_manager.cc:5495] T 3d91f2cadaec47a0b2f6f594c171b9f5 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:33.207649 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.037s user 0.020s sys 0.016s Metrics: {"bytes_written":336,"cfile_cache_hit":13,"cfile_cache_hit_bytes":25847,"cfile_cache_miss":31,"cfile_cache_miss_bytes":38787,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":6,"dirs.queue_time_us":725,"dirs.run_cpu_time_us":193,"dirs.run_wall_time_us":1330,"drs_written":1,"lbm_read_time_us":1571,"lbm_reads_lt_1ms":63,"lbm_write_time_us":1844,"lbm_writes_lt_1ms":32,"mutex_wait_us":45,"num_input_rowsets":2,"peak_mem_usage":18401,"reinsert_count":0,"rows_written":135,"spinlock_wait_cycles":8320,"update_count":1}
I20260807 18:14:33.208779 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 5889 bytes on disk
I20260807 18:14:33.209510 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":74,"lbm_reads_lt_1ms":4}
I20260807 18:14:33.223579 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49608:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.67"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:33.237778 25147 tablet_service.cc:1467] Processing CreateTablet for tablet d2c0f0c871f3490383af4706f193a40f (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.67 [id=e284bbfe129242d8934e810c14fa611b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:33.238416 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2c0f0c871f3490383af4706f193a40f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:33.243927 25269 tablet_bootstrap.cc:492] T d2c0f0c871f3490383af4706f193a40f P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:33.246417 25269 tablet_bootstrap.cc:654] T d2c0f0c871f3490383af4706f193a40f P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:33.249243 25269 tablet_bootstrap.cc:492] T d2c0f0c871f3490383af4706f193a40f P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:33.249526 25269 ts_tablet_manager.cc:1397] T d2c0f0c871f3490383af4706f193a40f P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s
I20260807 18:14:33.250437 25269 raft_consensus.cc:348] T d2c0f0c871f3490383af4706f193a40f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.250672 25269 raft_consensus.cc:374] T d2c0f0c871f3490383af4706f193a40f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:33.250792 25269 raft_consensus.cc:729] T d2c0f0c871f3490383af4706f193a40f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:33.251070 25269 consensus_queue.cc:260] T d2c0f0c871f3490383af4706f193a40f P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.251273 25269 raft_consensus.cc:388] T d2c0f0c871f3490383af4706f193a40f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:33.251418 25269 raft_consensus.cc:482] T d2c0f0c871f3490383af4706f193a40f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:33.251591 25269 raft_consensus.cc:3037] T d2c0f0c871f3490383af4706f193a40f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:33.254187 25269 raft_consensus.cc:504] T d2c0f0c871f3490383af4706f193a40f P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.254545 25269 leader_election.cc:302] T d2c0f0c871f3490383af4706f193a40f P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:33.254846 25269 leader_election.cc:288] T d2c0f0c871f3490383af4706f193a40f P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:33.254936 25275 raft_consensus.cc:2781] T d2c0f0c871f3490383af4706f193a40f P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:33.255194 25275 raft_consensus.cc:686] T d2c0f0c871f3490383af4706f193a40f P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:33.255359 25269 ts_tablet_manager.cc:1428] T d2c0f0c871f3490383af4706f193a40f P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.001s sys 0.003s
I20260807 18:14:33.255496 25275 consensus_queue.cc:237] T d2c0f0c871f3490383af4706f193a40f P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.261165 24957 catalog_manager.cc:5495] T d2c0f0c871f3490383af4706f193a40f P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:33.299686 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49610:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:33.311976 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 7bb2726b992940ba8f7952e2b9921cca (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.68 [id=6b307906d66d48bb815200b2465f3313]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:33.312574 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bb2726b992940ba8f7952e2b9921cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:33.319244 25269 tablet_bootstrap.cc:492] T 7bb2726b992940ba8f7952e2b9921cca P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:33.321728 25269 tablet_bootstrap.cc:654] T 7bb2726b992940ba8f7952e2b9921cca P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:33.325182 25269 tablet_bootstrap.cc:492] T 7bb2726b992940ba8f7952e2b9921cca P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:33.325392 25269 ts_tablet_manager.cc:1397] T 7bb2726b992940ba8f7952e2b9921cca P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 18:14:33.326375 25269 raft_consensus.cc:348] T 7bb2726b992940ba8f7952e2b9921cca P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.326637 25269 raft_consensus.cc:374] T 7bb2726b992940ba8f7952e2b9921cca P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:33.326771 25269 raft_consensus.cc:729] T 7bb2726b992940ba8f7952e2b9921cca P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:33.327065 25269 consensus_queue.cc:260] T 7bb2726b992940ba8f7952e2b9921cca P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.327430 25269 raft_consensus.cc:388] T 7bb2726b992940ba8f7952e2b9921cca P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:33.327592 25269 raft_consensus.cc:482] T 7bb2726b992940ba8f7952e2b9921cca P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:33.327848 25269 raft_consensus.cc:3037] T 7bb2726b992940ba8f7952e2b9921cca P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:33.330580 25269 raft_consensus.cc:504] T 7bb2726b992940ba8f7952e2b9921cca P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.330937 25269 leader_election.cc:302] T 7bb2726b992940ba8f7952e2b9921cca P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:33.331202 25269 leader_election.cc:288] T 7bb2726b992940ba8f7952e2b9921cca P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:33.331338 25275 raft_consensus.cc:2781] T 7bb2726b992940ba8f7952e2b9921cca P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:33.331632 25275 raft_consensus.cc:686] T 7bb2726b992940ba8f7952e2b9921cca P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:33.331847 25269 ts_tablet_manager.cc:1428] T 7bb2726b992940ba8f7952e2b9921cca P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.002s sys 0.002s
I20260807 18:14:33.332036 25275 consensus_queue.cc:237] T 7bb2726b992940ba8f7952e2b9921cca P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.339517 24957 catalog_manager.cc:5495] T 7bb2726b992940ba8f7952e2b9921cca P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:33.379932 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000083
I20260807 18:14:33.382997 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49620:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.69"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:33.397130 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.017s user 0.013s sys 0.000s Metrics: {"bytes_written":6066,"cfile_init":1,"dirs.queue_time_us":100,"dirs.run_cpu_time_us":189,"dirs.run_wall_time_us":1439,"drs_written":1,"lbm_read_time_us":80,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1199,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:33.398545 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 517 bytes on disk
I20260807 18:14:33.399274 25147 tablet_service.cc:1467] Processing CreateTablet for tablet a413e8f00119490883b3ed0e62b7ae34 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.69 [id=6f13f3ab2c7f4686972c5d0c719a499f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:33.399363 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":91,"lbm_reads_lt_1ms":4}
I20260807 18:14:33.399860 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a413e8f00119490883b3ed0e62b7ae34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:33.399992 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.248995
I20260807 18:14:33.407770 25269 tablet_bootstrap.cc:492] T a413e8f00119490883b3ed0e62b7ae34 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:33.410338 25269 tablet_bootstrap.cc:654] T a413e8f00119490883b3ed0e62b7ae34 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:33.413802 25269 tablet_bootstrap.cc:492] T a413e8f00119490883b3ed0e62b7ae34 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:33.414081 25269 ts_tablet_manager.cc:1397] T a413e8f00119490883b3ed0e62b7ae34 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 18:14:33.415339 25269 raft_consensus.cc:348] T a413e8f00119490883b3ed0e62b7ae34 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.415714 25269 raft_consensus.cc:374] T a413e8f00119490883b3ed0e62b7ae34 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:33.415868 25269 raft_consensus.cc:729] T a413e8f00119490883b3ed0e62b7ae34 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:33.416303 25269 consensus_queue.cc:260] T a413e8f00119490883b3ed0e62b7ae34 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.416563 25269 raft_consensus.cc:388] T a413e8f00119490883b3ed0e62b7ae34 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:33.416774 25269 raft_consensus.cc:482] T a413e8f00119490883b3ed0e62b7ae34 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:33.416960 25269 raft_consensus.cc:3037] T a413e8f00119490883b3ed0e62b7ae34 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:33.419430 25269 raft_consensus.cc:504] T a413e8f00119490883b3ed0e62b7ae34 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.419767 25269 leader_election.cc:302] T a413e8f00119490883b3ed0e62b7ae34 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:33.420137 25269 leader_election.cc:288] T a413e8f00119490883b3ed0e62b7ae34 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:33.420171 25275 raft_consensus.cc:2781] T a413e8f00119490883b3ed0e62b7ae34 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:33.420506 25275 raft_consensus.cc:686] T a413e8f00119490883b3ed0e62b7ae34 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:33.420876 25275 consensus_queue.cc:237] T a413e8f00119490883b3ed0e62b7ae34 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.421479 25269 ts_tablet_manager.cc:1428] T a413e8f00119490883b3ed0e62b7ae34 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20260807 18:14:33.427765 24957 catalog_manager.cc:5495] T a413e8f00119490883b3ed0e62b7ae34 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:33.435689 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.035s user 0.020s sys 0.012s Metrics: {"bytes_written":35847,"cfile_cache_hit":13,"cfile_cache_hit_bytes":26622,"cfile_cache_miss":31,"cfile_cache_miss_bytes":39868,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":1015,"dirs.run_cpu_time_us":178,"dirs.run_wall_time_us":1100,"drs_written":1,"lbm_read_time_us":1226,"lbm_reads_lt_1ms":63,"lbm_write_time_us":1183,"lbm_writes_lt_1ms":28,"mutex_wait_us":190,"num_input_rowsets":2,"peak_mem_usage":19689,"rows_written":139,"spinlock_wait_cycles":896}
I20260807 18:14:33.436750 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000011
I20260807 18:14:33.453698 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.017s user 0.012s sys 0.004s Metrics: {"bytes_written":334,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":182,"dirs.run_cpu_time_us":218,"dirs.run_wall_time_us":1402,"drs_written":1,"lbm_read_time_us":116,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1276,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":2,"update_count":1}
I20260807 18:14:33.454643 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 6424 bytes on disk
I20260807 18:14:33.455591 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":178,"lbm_reads_lt_1ms":8}
I20260807 18:14:33.456349 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.441799
I20260807 18:14:33.460553 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000082
I20260807 18:14:33.466336 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.010s user 0.007s sys 0.003s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":611,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":167,"lbm_read_time_us":395,"lbm_reads_lt_1ms":21,"lbm_write_time_us":270,"lbm_writes_lt_1ms":9,"mutex_wait_us":37,"reinsert_count":0,"update_count":1}
I20260807 18:14:33.467129 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.234874
I20260807 18:14:33.475502 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.015s user 0.008s sys 0.005s Metrics: {"bytes_written":6065,"cfile_init":1,"dirs.queue_time_us":76,"dirs.run_cpu_time_us":224,"dirs.run_wall_time_us":1107,"drs_written":1,"lbm_read_time_us":84,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1209,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:33.476794 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 547 bytes on disk
I20260807 18:14:33.477759 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":118,"lbm_reads_lt_1ms":4}
I20260807 18:14:33.478426 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.248423
I20260807 18:14:33.506211 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49630:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:33.512092 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.045s user 0.026s sys 0.016s Metrics: {"bytes_written":36291,"cfile_cache_hit":13,"cfile_cache_hit_bytes":27028,"cfile_cache_miss":31,"cfile_cache_miss_bytes":40462,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":980,"dirs.run_cpu_time_us":1103,"dirs.run_wall_time_us":6499,"drs_written":1,"lbm_read_time_us":2112,"lbm_reads_lt_1ms":63,"lbm_write_time_us":1647,"lbm_writes_lt_1ms":28,"mutex_wait_us":231,"num_input_rowsets":2,"peak_mem_usage":20112,"rows_written":141,"spinlock_wait_cycles":12928,"thread_start_us":2031,"threads_started":1}
I20260807 18:14:33.513267 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 6162 bytes on disk
I20260807 18:14:33.517112 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":93,"lbm_reads_lt_1ms":4}
I20260807 18:14:33.518312 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000018
I20260807 18:14:33.524065 25147 tablet_service.cc:1467] Processing CreateTablet for tablet cb211cda3e10418abfa61c073c3d2afc (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.70 [id=0157c3d2d22048a2b2f773fd072d3bcc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:33.524674 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb211cda3e10418abfa61c073c3d2afc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:33.528168 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.049s user 0.023s sys 0.018s Metrics: {"bytes_written":36291,"cfile_cache_hit":13,"cfile_cache_hit_bytes":26986,"cfile_cache_miss":31,"cfile_cache_miss_bytes":40448,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":453,"dirs.run_cpu_time_us":521,"dirs.run_wall_time_us":3166,"drs_written":1,"lbm_read_time_us":1873,"lbm_reads_lt_1ms":63,"lbm_write_time_us":1659,"lbm_writes_lt_1ms":28,"mutex_wait_us":78,"num_input_rowsets":2,"peak_mem_usage":20153,"rows_written":141,"spinlock_wait_cycles":23936}
I20260807 18:14:33.529170 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000015
I20260807 18:14:33.533068 25269 tablet_bootstrap.cc:492] T cb211cda3e10418abfa61c073c3d2afc P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:33.536530 25269 tablet_bootstrap.cc:654] T cb211cda3e10418abfa61c073c3d2afc P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:33.539625 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.021s user 0.014s sys 0.004s Metrics: {"bytes_written":329,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":307,"dirs.run_cpu_time_us":130,"dirs.run_wall_time_us":1399,"drs_written":1,"lbm_read_time_us":122,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1643,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":2,"update_count":1}
I20260807 18:14:33.541113 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.540230
I20260807 18:14:33.549091 25269 tablet_bootstrap.cc:492] T cb211cda3e10418abfa61c073c3d2afc P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:33.549408 25269 ts_tablet_manager.cc:1397] T cb211cda3e10418abfa61c073c3d2afc P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.003s
I20260807 18:14:33.550701 25269 raft_consensus.cc:348] T cb211cda3e10418abfa61c073c3d2afc P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.550690 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.021s user 0.001s sys 0.015s Metrics: {"bytes_written":5157,"cfile_init":1,"dirs.queue_time_us":41,"dirs.run_cpu_time_us":164,"dirs.run_wall_time_us":1107,"drs_written":1,"lbm_read_time_us":72,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2506,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":26,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:33.551033 25269 raft_consensus.cc:374] T cb211cda3e10418abfa61c073c3d2afc P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:33.551295 25269 raft_consensus.cc:729] T cb211cda3e10418abfa61c073c3d2afc P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:33.551761 25269 consensus_queue.cc:260] T cb211cda3e10418abfa61c073c3d2afc P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.551795 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.229337
I20260807 18:14:33.552055 25269 raft_consensus.cc:388] T cb211cda3e10418abfa61c073c3d2afc P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:33.552179 25269 raft_consensus.cc:482] T cb211cda3e10418abfa61c073c3d2afc P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:33.552341 25269 raft_consensus.cc:3037] T cb211cda3e10418abfa61c073c3d2afc P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:33.556347 25269 raft_consensus.cc:504] T cb211cda3e10418abfa61c073c3d2afc P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.556843 25269 leader_election.cc:302] T cb211cda3e10418abfa61c073c3d2afc P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:33.557379 25275 raft_consensus.cc:2781] T cb211cda3e10418abfa61c073c3d2afc P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:33.557675 25275 raft_consensus.cc:686] T cb211cda3e10418abfa61c073c3d2afc P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:33.558125 25275 consensus_queue.cc:237] T cb211cda3e10418abfa61c073c3d2afc P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.563303 25269 leader_election.cc:288] T cb211cda3e10418abfa61c073c3d2afc P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:33.564088 25269 ts_tablet_manager.cc:1428] T cb211cda3e10418abfa61c073c3d2afc P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.014s user 0.004s sys 0.003s
I20260807 18:14:33.563112 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.021s user 0.005s sys 0.011s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":459,"cfile_init":5,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":109,"lbm_read_time_us":751,"lbm_reads_lt_1ms":25,"lbm_write_time_us":490,"lbm_writes_lt_1ms":9,"reinsert_count":0,"update_count":1}
I20260807 18:14:33.566196 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 167 bytes on disk
I20260807 18:14:33.567082 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":98,"lbm_reads_lt_1ms":4}
I20260807 18:14:33.568255 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.229337
I20260807 18:14:33.573571 24957 catalog_manager.cc:5495] T cb211cda3e10418abfa61c073c3d2afc P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:33.604876 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.053s user 0.026s sys 0.019s Metrics: {"bytes_written":333,"cfile_cache_hit":12,"cfile_cache_hit_bytes":27330,"cfile_cache_miss":28,"cfile_cache_miss_bytes":40324,"cfile_init":9,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":516,"dirs.run_cpu_time_us":555,"dirs.run_wall_time_us":2376,"drs_written":1,"lbm_read_time_us":1626,"lbm_reads_lt_1ms":64,"lbm_write_time_us":2155,"lbm_writes_lt_1ms":32,"mutex_wait_us":23,"num_input_rowsets":2,"peak_mem_usage":20182,"reinsert_count":0,"rows_written":143,"spinlock_wait_cycles":3840,"update_count":1}
I20260807 18:14:33.606184 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 6232 bytes on disk
I20260807 18:14:33.607020 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":79,"lbm_reads_lt_1ms":4}
I20260807 18:14:33.607791 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.000002
I20260807 18:14:33.615197 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.047s user 0.028s sys 0.014s Metrics: {"bytes_written":389,"cfile_cache_hit":13,"cfile_cache_hit_bytes":27363,"cfile_cache_miss":31,"cfile_cache_miss_bytes":40393,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":6,"dirs.queue_time_us":764,"dirs.run_cpu_time_us":996,"dirs.run_wall_time_us":4926,"drs_written":1,"lbm_read_time_us":1582,"lbm_reads_lt_1ms":63,"lbm_write_time_us":2734,"lbm_writes_lt_1ms":32,"mutex_wait_us":67,"num_input_rowsets":2,"peak_mem_usage":20199,"reinsert_count":0,"rows_written":143,"update_count":2}
I20260807 18:14:33.616328 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 6232 bytes on disk
I20260807 18:14:33.617074 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":112,"lbm_reads_lt_1ms":4}
I20260807 18:14:33.617271 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.008s user 0.003s sys 0.000s Metrics: {"bytes_written":336,"delete_count":0,"lbm_write_time_us":170,"lbm_writes_lt_1ms":4,"reinsert_count":0,"update_count":1}
I20260807 18:14:33.617933 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260807 18:14:33.625638 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.007s user 0.007s sys 0.000s Metrics: {"cfile_cache_miss":4,"cfile_cache_miss_bytes":467,"cfile_init":1,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":81,"lbm_read_time_us":114,"lbm_reads_lt_1ms":8,"lbm_write_time_us":158,"lbm_writes_lt_1ms":4,"reinsert_count":0,"update_count":2}
I20260807 18:14:33.641842 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49642:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.71"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:33.654867 25147 tablet_service.cc:1467] Processing CreateTablet for tablet ca1f917eec0740bb931db03aeb1b62e0 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.71 [id=56fb2308bc8043dd808683b9b4029acb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:33.655561 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca1f917eec0740bb931db03aeb1b62e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:33.662477 25269 tablet_bootstrap.cc:492] T ca1f917eec0740bb931db03aeb1b62e0 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:33.665444 25269 tablet_bootstrap.cc:654] T ca1f917eec0740bb931db03aeb1b62e0 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:33.668910 25269 tablet_bootstrap.cc:492] T ca1f917eec0740bb931db03aeb1b62e0 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:33.669178 25269 ts_tablet_manager.cc:1397] T ca1f917eec0740bb931db03aeb1b62e0 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.004s
I20260807 18:14:33.670149 25269 raft_consensus.cc:348] T ca1f917eec0740bb931db03aeb1b62e0 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.670459 25269 raft_consensus.cc:374] T ca1f917eec0740bb931db03aeb1b62e0 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:33.670641 25269 raft_consensus.cc:729] T ca1f917eec0740bb931db03aeb1b62e0 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:33.671066 25269 consensus_queue.cc:260] T ca1f917eec0740bb931db03aeb1b62e0 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.671341 25269 raft_consensus.cc:388] T ca1f917eec0740bb931db03aeb1b62e0 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:33.671566 25269 raft_consensus.cc:482] T ca1f917eec0740bb931db03aeb1b62e0 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:33.671738 25269 raft_consensus.cc:3037] T ca1f917eec0740bb931db03aeb1b62e0 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:33.674863 25269 raft_consensus.cc:504] T ca1f917eec0740bb931db03aeb1b62e0 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.675191 25269 leader_election.cc:302] T ca1f917eec0740bb931db03aeb1b62e0 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:33.675503 25269 leader_election.cc:288] T ca1f917eec0740bb931db03aeb1b62e0 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:33.675550 25275 raft_consensus.cc:2781] T ca1f917eec0740bb931db03aeb1b62e0 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:33.675920 25275 raft_consensus.cc:686] T ca1f917eec0740bb931db03aeb1b62e0 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:33.676316 25269 ts_tablet_manager.cc:1428] T ca1f917eec0740bb931db03aeb1b62e0 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260807 18:14:33.676242 25275 consensus_queue.cc:237] T ca1f917eec0740bb931db03aeb1b62e0 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.683214 24957 catalog_manager.cc:5495] T ca1f917eec0740bb931db03aeb1b62e0 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:33.727097 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49648:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.72"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:33.741026 25147 tablet_service.cc:1467] Processing CreateTablet for tablet c9ccf202f43f405586db65c237265cc6 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.72 [id=fd8299ad3c6541a7ae689c8f142be782]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:33.741700 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9ccf202f43f405586db65c237265cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:33.749411 25269 tablet_bootstrap.cc:492] T c9ccf202f43f405586db65c237265cc6 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:33.752610 25269 tablet_bootstrap.cc:654] T c9ccf202f43f405586db65c237265cc6 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:33.756564 25269 tablet_bootstrap.cc:492] T c9ccf202f43f405586db65c237265cc6 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:33.756798 25269 ts_tablet_manager.cc:1397] T c9ccf202f43f405586db65c237265cc6 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260807 18:14:33.757840 25269 raft_consensus.cc:348] T c9ccf202f43f405586db65c237265cc6 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.758237 25269 raft_consensus.cc:374] T c9ccf202f43f405586db65c237265cc6 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:33.758474 25269 raft_consensus.cc:729] T c9ccf202f43f405586db65c237265cc6 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:33.758812 25269 consensus_queue.cc:260] T c9ccf202f43f405586db65c237265cc6 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.759228 25269 raft_consensus.cc:388] T c9ccf202f43f405586db65c237265cc6 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:33.759400 25269 raft_consensus.cc:482] T c9ccf202f43f405586db65c237265cc6 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:33.759627 25269 raft_consensus.cc:3037] T c9ccf202f43f405586db65c237265cc6 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:33.762262 25269 raft_consensus.cc:504] T c9ccf202f43f405586db65c237265cc6 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.762676 25269 leader_election.cc:302] T c9ccf202f43f405586db65c237265cc6 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:33.762974 25269 leader_election.cc:288] T c9ccf202f43f405586db65c237265cc6 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:33.763173 25275 raft_consensus.cc:2781] T c9ccf202f43f405586db65c237265cc6 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:33.763476 25275 raft_consensus.cc:686] T c9ccf202f43f405586db65c237265cc6 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:33.764273 25275 consensus_queue.cc:237] T c9ccf202f43f405586db65c237265cc6 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.764914 25269 ts_tablet_manager.cc:1428] T c9ccf202f43f405586db65c237265cc6 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.001s sys 0.005s
I20260807 18:14:33.770900 24957 catalog_manager.cc:5495] T c9ccf202f43f405586db65c237265cc6 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:33.813908 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49658:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.73"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:33.826638 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 7d21cc51efa44f2bb020891ceeed9376 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.73 [id=b07373e06fb4491896abbc0724db7426]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:33.827169 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d21cc51efa44f2bb020891ceeed9376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:33.832852 25269 tablet_bootstrap.cc:492] T 7d21cc51efa44f2bb020891ceeed9376 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:33.835403 25269 tablet_bootstrap.cc:654] T 7d21cc51efa44f2bb020891ceeed9376 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:33.838845 25269 tablet_bootstrap.cc:492] T 7d21cc51efa44f2bb020891ceeed9376 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:33.839039 25269 ts_tablet_manager.cc:1397] T 7d21cc51efa44f2bb020891ceeed9376 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260807 18:14:33.839936 25269 raft_consensus.cc:348] T 7d21cc51efa44f2bb020891ceeed9376 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.840200 25269 raft_consensus.cc:374] T 7d21cc51efa44f2bb020891ceeed9376 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:33.840302 25269 raft_consensus.cc:729] T 7d21cc51efa44f2bb020891ceeed9376 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:33.840579 25269 consensus_queue.cc:260] T 7d21cc51efa44f2bb020891ceeed9376 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.840783 25269 raft_consensus.cc:388] T 7d21cc51efa44f2bb020891ceeed9376 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:33.840929 25269 raft_consensus.cc:482] T 7d21cc51efa44f2bb020891ceeed9376 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:33.841039 25269 raft_consensus.cc:3037] T 7d21cc51efa44f2bb020891ceeed9376 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:33.844234 25269 raft_consensus.cc:504] T 7d21cc51efa44f2bb020891ceeed9376 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.844486 25269 leader_election.cc:302] T 7d21cc51efa44f2bb020891ceeed9376 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:33.844743 25269 leader_election.cc:288] T 7d21cc51efa44f2bb020891ceeed9376 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:33.844853 25275 raft_consensus.cc:2781] T 7d21cc51efa44f2bb020891ceeed9376 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:33.845078 25275 raft_consensus.cc:686] T 7d21cc51efa44f2bb020891ceeed9376 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:33.845451 25269 ts_tablet_manager.cc:1428] T 7d21cc51efa44f2bb020891ceeed9376 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260807 18:14:33.845459 25275 consensus_queue.cc:237] T 7d21cc51efa44f2bb020891ceeed9376 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.852475 24957 catalog_manager.cc:5495] T 7d21cc51efa44f2bb020891ceeed9376 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:33.868209 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000091
I20260807 18:14:33.877054 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000091
I20260807 18:14:33.883985 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.015s user 0.010s sys 0.000s Metrics: {"bytes_written":6065,"cfile_init":1,"dirs.queue_time_us":71,"dirs.run_cpu_time_us":210,"dirs.run_wall_time_us":1277,"drs_written":1,"lbm_read_time_us":66,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1064,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:33.885380 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.246383
I20260807 18:14:33.894980 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.017s user 0.007s sys 0.006s Metrics: {"bytes_written":6065,"cfile_init":1,"dirs.queue_time_us":69,"dirs.run_cpu_time_us":237,"dirs.run_wall_time_us":1209,"drs_written":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4,"lbm_write_time_us":4181,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":26,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:33.896255 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.246383
I20260807 18:14:33.927000 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49666:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:33.931955 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.046s user 0.037s sys 0.008s Metrics: {"bytes_written":38032,"cfile_cache_hit":13,"cfile_cache_hit_bytes":28462,"cfile_cache_miss":31,"cfile_cache_miss_bytes":42662,"cfile_init":9,"delta_iterators_relevant":6,"dirs.queue_time_us":519,"dirs.run_cpu_time_us":240,"dirs.run_wall_time_us":1322,"drs_written":1,"lbm_read_time_us":2071,"lbm_reads_lt_1ms":67,"lbm_write_time_us":1476,"lbm_writes_lt_1ms":28,"mutex_wait_us":135,"num_input_rowsets":2,"peak_mem_usage":21371,"rows_written":149}
I20260807 18:14:33.933449 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 6503 bytes on disk
I20260807 18:14:33.934360 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":106,"lbm_reads_lt_1ms":4}
I20260807 18:14:33.940739 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.044s user 0.035s sys 0.005s Metrics: {"bytes_written":38032,"cfile_cache_hit":13,"cfile_cache_hit_bytes":28462,"cfile_cache_miss":31,"cfile_cache_miss_bytes":42662,"cfile_init":9,"delta_iterators_relevant":6,"dirs.queue_time_us":1103,"dirs.run_cpu_time_us":226,"dirs.run_wall_time_us":1264,"drs_written":1,"lbm_read_time_us":1971,"lbm_reads_lt_1ms":67,"lbm_write_time_us":1701,"lbm_writes_lt_1ms":28,"num_input_rowsets":2,"peak_mem_usage":21371,"rows_written":149}
I20260807 18:14:33.942101 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000013
I20260807 18:14:33.946147 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 67e53408d1e64d759485472f8f485ec1 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.74 [id=287be7fead134c4a9fca85c21bad8d66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:33.946692 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67e53408d1e64d759485472f8f485ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:33.953814 25269 tablet_bootstrap.cc:492] T 67e53408d1e64d759485472f8f485ec1 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:33.957162 25269 tablet_bootstrap.cc:654] T 67e53408d1e64d759485472f8f485ec1 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:33.962110 25269 tablet_bootstrap.cc:492] T 67e53408d1e64d759485472f8f485ec1 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:33.962330 25269 ts_tablet_manager.cc:1397] T 67e53408d1e64d759485472f8f485ec1 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.005s
I20260807 18:14:33.963587 25269 raft_consensus.cc:348] T 67e53408d1e64d759485472f8f485ec1 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.963825 25269 raft_consensus.cc:374] T 67e53408d1e64d759485472f8f485ec1 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:33.964082 25269 raft_consensus.cc:729] T 67e53408d1e64d759485472f8f485ec1 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:33.964439 25269 consensus_queue.cc:260] T 67e53408d1e64d759485472f8f485ec1 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.964775 25269 raft_consensus.cc:388] T 67e53408d1e64d759485472f8f485ec1 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:33.964931 25269 raft_consensus.cc:482] T 67e53408d1e64d759485472f8f485ec1 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:33.965211 25269 raft_consensus.cc:3037] T 67e53408d1e64d759485472f8f485ec1 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:33.969609 25269 raft_consensus.cc:504] T 67e53408d1e64d759485472f8f485ec1 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.970057 25269 leader_election.cc:302] T 67e53408d1e64d759485472f8f485ec1 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:33.970534 25275 raft_consensus.cc:2781] T 67e53408d1e64d759485472f8f485ec1 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:33.970834 25275 raft_consensus.cc:686] T 67e53408d1e64d759485472f8f485ec1 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:33.970675 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.028s user 0.013s sys 0.006s Metrics: {"bytes_written":329,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":56,"dirs.run_cpu_time_us":174,"dirs.run_wall_time_us":1171,"drs_written":1,"lbm_read_time_us":75,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1935,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":2,"spinlock_wait_cycles":896,"update_count":1}
I20260807 18:14:33.971347 25275 consensus_queue.cc:237] T 67e53408d1e64d759485472f8f485ec1 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:33.971920 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 6670 bytes on disk
I20260807 18:14:33.972900 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":186,"lbm_reads_lt_1ms":8}
I20260807 18:14:33.973776 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.540230
I20260807 18:14:33.984357 24957 catalog_manager.cc:5495] T 67e53408d1e64d759485472f8f485ec1 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:33.984766 25269 leader_election.cc:288] T 67e53408d1e64d759485472f8f485ec1 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:33.993153 25269 ts_tablet_manager.cc:1428] T 67e53408d1e64d759485472f8f485ec1 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.031s user 0.006s sys 0.003s
I20260807 18:14:34.009394 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.035s user 0.012s sys 0.001s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":459,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":98,"lbm_read_time_us":555,"lbm_reads_lt_1ms":21,"lbm_write_time_us":439,"lbm_writes_lt_1ms":9,"mutex_wait_us":3,"reinsert_count":0,"spinlock_wait_cycles":10624,"update_count":1}
I20260807 18:14:34.010412 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.205226
I20260807 18:14:34.061537 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.050s user 0.034s sys 0.012s Metrics: {"bytes_written":336,"cfile_cache_hit":13,"cfile_cache_hit_bytes":28839,"cfile_cache_miss":31,"cfile_cache_miss_bytes":42551,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":6,"dirs.queue_time_us":880,"dirs.run_cpu_time_us":1182,"dirs.run_wall_time_us":5894,"drs_written":1,"lbm_read_time_us":1575,"lbm_reads_lt_1ms":63,"lbm_write_time_us":1988,"lbm_writes_lt_1ms":32,"mutex_wait_us":105,"num_input_rowsets":2,"peak_mem_usage":21423,"reinsert_count":0,"rows_written":151,"thread_start_us":638,"threads_started":1,"update_count":1}
I20260807 18:14:34.062650 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 6581 bytes on disk
I20260807 18:14:34.063279 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":79,"lbm_reads_lt_1ms":4}
I20260807 18:14:34.064090 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49680:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.75"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:34.077273 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 6b605ba389f647beb4f48b0972273d6a (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.75 [id=c595e074150e489197efb9251eb982f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:34.077888 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b605ba389f647beb4f48b0972273d6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:34.084403 25269 tablet_bootstrap.cc:492] T 6b605ba389f647beb4f48b0972273d6a P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:34.087183 25269 tablet_bootstrap.cc:654] T 6b605ba389f647beb4f48b0972273d6a P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:34.090781 25269 tablet_bootstrap.cc:492] T 6b605ba389f647beb4f48b0972273d6a P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:34.091079 25269 ts_tablet_manager.cc:1397] T 6b605ba389f647beb4f48b0972273d6a P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.003s
I20260807 18:14:34.091960 25269 raft_consensus.cc:348] T 6b605ba389f647beb4f48b0972273d6a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.092335 25269 raft_consensus.cc:374] T 6b605ba389f647beb4f48b0972273d6a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:34.092512 25269 raft_consensus.cc:729] T 6b605ba389f647beb4f48b0972273d6a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:34.092866 25269 consensus_queue.cc:260] T 6b605ba389f647beb4f48b0972273d6a P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.093128 25269 raft_consensus.cc:388] T 6b605ba389f647beb4f48b0972273d6a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:34.093417 25269 raft_consensus.cc:482] T 6b605ba389f647beb4f48b0972273d6a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:34.093634 25269 raft_consensus.cc:3037] T 6b605ba389f647beb4f48b0972273d6a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:34.096503 25269 raft_consensus.cc:504] T 6b605ba389f647beb4f48b0972273d6a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.096860 25269 leader_election.cc:302] T 6b605ba389f647beb4f48b0972273d6a P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:34.097175 25269 leader_election.cc:288] T 6b605ba389f647beb4f48b0972273d6a P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:34.097276 25275 raft_consensus.cc:2781] T 6b605ba389f647beb4f48b0972273d6a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:34.097769 25275 raft_consensus.cc:686] T 6b605ba389f647beb4f48b0972273d6a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:34.098053 25275 consensus_queue.cc:237] T 6b605ba389f647beb4f48b0972273d6a P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.098141 25269 ts_tablet_manager.cc:1428] T 6b605ba389f647beb4f48b0972273d6a P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260807 18:14:34.105547 24957 catalog_manager.cc:5495] T 6b605ba389f647beb4f48b0972273d6a P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:34.151218 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49686:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.76"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:34.166918 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 7e2b092f79f6459098f55c9930437f5c (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.76 [id=f90b6ad66c7546c0b0429c21116412c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:34.167716 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e2b092f79f6459098f55c9930437f5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:34.176843 25269 tablet_bootstrap.cc:492] T 7e2b092f79f6459098f55c9930437f5c P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:34.179708 25269 tablet_bootstrap.cc:654] T 7e2b092f79f6459098f55c9930437f5c P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:34.183852 25269 tablet_bootstrap.cc:492] T 7e2b092f79f6459098f55c9930437f5c P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:34.184125 25269 ts_tablet_manager.cc:1397] T 7e2b092f79f6459098f55c9930437f5c P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.001s
I20260807 18:14:34.185583 25269 raft_consensus.cc:348] T 7e2b092f79f6459098f55c9930437f5c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.185788 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000084
I20260807 18:14:34.185850 25269 raft_consensus.cc:374] T 7e2b092f79f6459098f55c9930437f5c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:34.186089 25269 raft_consensus.cc:729] T 7e2b092f79f6459098f55c9930437f5c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:34.186442 25269 consensus_queue.cc:260] T 7e2b092f79f6459098f55c9930437f5c P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.186795 25269 raft_consensus.cc:388] T 7e2b092f79f6459098f55c9930437f5c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:34.187005 25269 raft_consensus.cc:482] T 7e2b092f79f6459098f55c9930437f5c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:34.187333 25269 raft_consensus.cc:3037] T 7e2b092f79f6459098f55c9930437f5c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:34.191941 25269 raft_consensus.cc:504] T 7e2b092f79f6459098f55c9930437f5c P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.192478 25269 leader_election.cc:302] T 7e2b092f79f6459098f55c9930437f5c P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:34.192842 25269 leader_election.cc:288] T 7e2b092f79f6459098f55c9930437f5c P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:34.192920 25275 raft_consensus.cc:2781] T 7e2b092f79f6459098f55c9930437f5c P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:34.193274 25275 raft_consensus.cc:686] T 7e2b092f79f6459098f55c9930437f5c P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:34.193698 25275 consensus_queue.cc:237] T 7e2b092f79f6459098f55c9930437f5c P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.193967 25269 ts_tablet_manager.cc:1428] T 7e2b092f79f6459098f55c9930437f5c P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.010s user 0.005s sys 0.005s
I20260807 18:14:34.202616 24956 catalog_manager.cc:5495] T 7e2b092f79f6459098f55c9930437f5c P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:34.206795 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.021s user 0.011s sys 0.008s Metrics: {"bytes_written":6028,"cfile_init":1,"dirs.queue_time_us":953,"dirs.run_cpu_time_us":279,"dirs.run_wall_time_us":6088,"drs_written":1,"lbm_read_time_us":94,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1420,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6,"spinlock_wait_cycles":53632}
I20260807 18:14:34.208185 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.219827
I20260807 18:14:34.244660 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.036s user 0.026s sys 0.009s Metrics: {"bytes_written":336,"cfile_cache_hit":12,"cfile_cache_hit_bytes":29540,"cfile_cache_miss":28,"cfile_cache_miss_bytes":43800,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":874,"dirs.run_cpu_time_us":1009,"dirs.run_wall_time_us":4139,"drs_written":1,"lbm_read_time_us":922,"lbm_reads_lt_1ms":60,"lbm_write_time_us":1759,"lbm_writes_lt_1ms":32,"mutex_wait_us":71,"num_input_rowsets":2,"peak_mem_usage":22118,"reinsert_count":0,"rows_written":155,"spinlock_wait_cycles":3840,"update_count":1}
I20260807 18:14:34.246877 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 6747 bytes on disk
I20260807 18:14:34.247807 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":95,"lbm_reads_lt_1ms":4}
I20260807 18:14:34.259119 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49688:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.77"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:34.275981 25147 tablet_service.cc:1467] Processing CreateTablet for tablet eebf41dab05e4c8db00f052e480b8fcb (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.77 [id=51412a266f024c1c949dc94257d34e9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:34.276517 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eebf41dab05e4c8db00f052e480b8fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:34.281767 25269 tablet_bootstrap.cc:492] T eebf41dab05e4c8db00f052e480b8fcb P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:34.283691 25269 tablet_bootstrap.cc:654] T eebf41dab05e4c8db00f052e480b8fcb P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:34.286525 25269 tablet_bootstrap.cc:492] T eebf41dab05e4c8db00f052e480b8fcb P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:34.286731 25269 ts_tablet_manager.cc:1397] T eebf41dab05e4c8db00f052e480b8fcb P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20260807 18:14:34.287701 25269 raft_consensus.cc:348] T eebf41dab05e4c8db00f052e480b8fcb P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.288144 25269 raft_consensus.cc:374] T eebf41dab05e4c8db00f052e480b8fcb P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:34.288324 25269 raft_consensus.cc:729] T eebf41dab05e4c8db00f052e480b8fcb P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:34.288627 25269 consensus_queue.cc:260] T eebf41dab05e4c8db00f052e480b8fcb P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.288812 25269 raft_consensus.cc:388] T eebf41dab05e4c8db00f052e480b8fcb P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:34.288940 25269 raft_consensus.cc:482] T eebf41dab05e4c8db00f052e480b8fcb P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:34.289060 25269 raft_consensus.cc:3037] T eebf41dab05e4c8db00f052e480b8fcb P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:34.291095 25269 raft_consensus.cc:504] T eebf41dab05e4c8db00f052e480b8fcb P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.291360 25269 leader_election.cc:302] T eebf41dab05e4c8db00f052e480b8fcb P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:34.291575 25269 leader_election.cc:288] T eebf41dab05e4c8db00f052e480b8fcb P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:34.291711 25275 raft_consensus.cc:2781] T eebf41dab05e4c8db00f052e480b8fcb P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:34.291970 25275 raft_consensus.cc:686] T eebf41dab05e4c8db00f052e480b8fcb P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:34.292099 25269 ts_tablet_manager.cc:1428] T eebf41dab05e4c8db00f052e480b8fcb P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260807 18:14:34.292233 25275 consensus_queue.cc:237] T eebf41dab05e4c8db00f052e480b8fcb P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.298802 24956 catalog_manager.cc:5495] T eebf41dab05e4c8db00f052e480b8fcb P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:34.314595 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000095
I20260807 18:14:34.331764 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.017s user 0.008s sys 0.006s Metrics: {"bytes_written":6066,"cfile_init":1,"dirs.queue_time_us":85,"dirs.run_cpu_time_us":250,"dirs.run_wall_time_us":1378,"drs_written":1,"lbm_read_time_us":84,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1350,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:34.333130 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 519 bytes on disk
I20260807 18:14:34.334117 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":136,"lbm_reads_lt_1ms":4}
I20260807 18:14:34.335084 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.245670
I20260807 18:14:34.340891 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49702:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:34.357396 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 0c3a478104b844af940902155ce2b0fc (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.78 [id=eb102dc53d2144c1a1d5263babeed032]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:34.358135 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c3a478104b844af940902155ce2b0fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:34.368124 25269 tablet_bootstrap.cc:492] T 0c3a478104b844af940902155ce2b0fc P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:34.370759 25269 tablet_bootstrap.cc:654] T 0c3a478104b844af940902155ce2b0fc P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:34.374069 25269 tablet_bootstrap.cc:492] T 0c3a478104b844af940902155ce2b0fc P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:34.374307 25269 ts_tablet_manager.cc:1397] T 0c3a478104b844af940902155ce2b0fc P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260807 18:14:34.375355 25269 raft_consensus.cc:348] T 0c3a478104b844af940902155ce2b0fc P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.375593 25269 raft_consensus.cc:374] T 0c3a478104b844af940902155ce2b0fc P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:34.375756 25269 raft_consensus.cc:729] T 0c3a478104b844af940902155ce2b0fc P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:34.376086 25269 consensus_queue.cc:260] T 0c3a478104b844af940902155ce2b0fc P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.376468 25269 raft_consensus.cc:388] T 0c3a478104b844af940902155ce2b0fc P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:34.376626 25269 raft_consensus.cc:482] T 0c3a478104b844af940902155ce2b0fc P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:34.376796 25269 raft_consensus.cc:3037] T 0c3a478104b844af940902155ce2b0fc P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:34.379278 25269 raft_consensus.cc:504] T 0c3a478104b844af940902155ce2b0fc P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.379647 25269 leader_election.cc:302] T 0c3a478104b844af940902155ce2b0fc P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:34.379940 25269 leader_election.cc:288] T 0c3a478104b844af940902155ce2b0fc P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:34.380278 25275 raft_consensus.cc:2781] T 0c3a478104b844af940902155ce2b0fc P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:34.380544 25275 raft_consensus.cc:686] T 0c3a478104b844af940902155ce2b0fc P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:34.380970 25269 ts_tablet_manager.cc:1428] T 0c3a478104b844af940902155ce2b0fc P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260807 18:14:34.380901 25275 consensus_queue.cc:237] T 0c3a478104b844af940902155ce2b0fc P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.380731 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.045s user 0.045s sys 0.000s Metrics: {"bytes_written":39779,"cfile_cache_hit":13,"cfile_cache_hit_bytes":29972,"cfile_cache_miss":31,"cfile_cache_miss_bytes":44770,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":1269,"dirs.run_cpu_time_us":466,"dirs.run_wall_time_us":2217,"drs_written":1,"lbm_read_time_us":1602,"lbm_reads_lt_1ms":63,"lbm_write_time_us":2026,"lbm_writes_lt_1ms":28,"mutex_wait_us":27,"num_input_rowsets":2,"peak_mem_usage":22562,"rows_written":157,"spinlock_wait_cycles":56192}
I20260807 18:14:34.382192 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000014
I20260807 18:14:34.388437 24956 catalog_manager.cc:5495] T 0c3a478104b844af940902155ce2b0fc P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:34.399586 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.017s user 0.014s sys 0.000s Metrics: {"bytes_written":5157,"cfile_init":1,"dirs.queue_time_us":62,"dirs.run_cpu_time_us":195,"dirs.run_wall_time_us":1219,"drs_written":1,"lbm_read_time_us":93,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1291,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:34.402117 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7086 bytes on disk
I20260807 18:14:34.402983 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":132,"lbm_reads_lt_1ms":8}
I20260807 18:14:34.403647 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.163239
I20260807 18:14:34.438962 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49706:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.79"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:34.441087 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.037s user 0.026s sys 0.006s Metrics: {"bytes_written":40205,"cfile_cache_hit":12,"cfile_cache_hit_bytes":30282,"cfile_cache_miss":28,"cfile_cache_miss_bytes":44658,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":1623,"dirs.run_cpu_time_us":251,"dirs.run_wall_time_us":1344,"drs_written":1,"lbm_read_time_us":1467,"lbm_reads_lt_1ms":56,"lbm_write_time_us":1330,"lbm_writes_lt_1ms":28,"num_input_rowsets":2,"peak_mem_usage":22541,"rows_written":159}
I20260807 18:14:34.442366 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 6934 bytes on disk
I20260807 18:14:34.443416 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":55,"lbm_reads_lt_1ms":4}
I20260807 18:14:34.453742 25147 tablet_service.cc:1467] Processing CreateTablet for tablet f089378e26234861903a10902360d0d3 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.79 [id=df28f80e968c406ca9c6b0ae21435411]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:34.454213 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f089378e26234861903a10902360d0d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:34.461422 25269 tablet_bootstrap.cc:492] T f089378e26234861903a10902360d0d3 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:34.463899 25269 tablet_bootstrap.cc:654] T f089378e26234861903a10902360d0d3 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:34.467833 25269 tablet_bootstrap.cc:492] T f089378e26234861903a10902360d0d3 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:34.468149 25269 ts_tablet_manager.cc:1397] T f089378e26234861903a10902360d0d3 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260807 18:14:34.469218 25269 raft_consensus.cc:348] T f089378e26234861903a10902360d0d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.469622 25269 raft_consensus.cc:374] T f089378e26234861903a10902360d0d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:34.469776 25269 raft_consensus.cc:729] T f089378e26234861903a10902360d0d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:34.470166 25269 consensus_queue.cc:260] T f089378e26234861903a10902360d0d3 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.470444 25269 raft_consensus.cc:388] T f089378e26234861903a10902360d0d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:34.470690 25269 raft_consensus.cc:482] T f089378e26234861903a10902360d0d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:34.470871 25269 raft_consensus.cc:3037] T f089378e26234861903a10902360d0d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:34.473459 25269 raft_consensus.cc:504] T f089378e26234861903a10902360d0d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.473837 25269 leader_election.cc:302] T f089378e26234861903a10902360d0d3 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:34.474225 25275 raft_consensus.cc:2781] T f089378e26234861903a10902360d0d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:34.474239 25269 leader_election.cc:288] T f089378e26234861903a10902360d0d3 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:34.474484 25275 raft_consensus.cc:686] T f089378e26234861903a10902360d0d3 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:34.474759 25275 consensus_queue.cc:237] T f089378e26234861903a10902360d0d3 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.474985 25269 ts_tablet_manager.cc:1428] T f089378e26234861903a10902360d0d3 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.006s sys 0.002s
I20260807 18:14:34.482002 24956 catalog_manager.cc:5495] T f089378e26234861903a10902360d0d3 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:34.498828 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000081
I20260807 18:14:34.511328 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.007s sys 0.004s Metrics: {"bytes_written":6066,"cfile_init":1,"dirs.queue_time_us":69,"dirs.run_cpu_time_us":252,"dirs.run_wall_time_us":1461,"drs_written":1,"lbm_read_time_us":61,"lbm_reads_lt_1ms":4,"lbm_write_time_us":754,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:34.512259 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.245276
I20260807 18:14:34.532770 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49710:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:34.548206 25147 tablet_service.cc:1467] Processing CreateTablet for tablet c2780c73aedb41dea02a65c3ea595d25 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.80 [id=961bca87112144fa9899b87226672dec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:34.548771 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2780c73aedb41dea02a65c3ea595d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:34.552663 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.040s user 0.024s sys 0.013s Metrics: {"bytes_written":40660,"cfile_cache_hit":13,"cfile_cache_hit_bytes":30676,"cfile_cache_miss":31,"cfile_cache_miss_bytes":45810,"cfile_init":9,"delta_iterators_relevant":6,"dirs.queue_time_us":1602,"dirs.run_cpu_time_us":689,"dirs.run_wall_time_us":3426,"drs_written":1,"lbm_read_time_us":1563,"lbm_reads_lt_1ms":67,"lbm_write_time_us":1446,"lbm_writes_lt_1ms":28,"mutex_wait_us":1035,"num_input_rowsets":2,"peak_mem_usage":23106,"rows_written":161}
I20260807 18:14:34.553756 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7015 bytes on disk
I20260807 18:14:34.554744 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":111,"lbm_reads_lt_1ms":4}
I20260807 18:14:34.555399 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000012
I20260807 18:14:34.558248 25269 tablet_bootstrap.cc:492] T c2780c73aedb41dea02a65c3ea595d25 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:34.560479 25269 tablet_bootstrap.cc:654] T c2780c73aedb41dea02a65c3ea595d25 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:34.563916 25269 tablet_bootstrap.cc:492] T c2780c73aedb41dea02a65c3ea595d25 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:34.564141 25269 ts_tablet_manager.cc:1397] T c2780c73aedb41dea02a65c3ea595d25 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260807 18:14:34.565294 25269 raft_consensus.cc:348] T c2780c73aedb41dea02a65c3ea595d25 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.565562 25269 raft_consensus.cc:374] T c2780c73aedb41dea02a65c3ea595d25 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:34.565737 25269 raft_consensus.cc:729] T c2780c73aedb41dea02a65c3ea595d25 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:34.566075 25269 consensus_queue.cc:260] T c2780c73aedb41dea02a65c3ea595d25 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.566440 25269 raft_consensus.cc:388] T c2780c73aedb41dea02a65c3ea595d25 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:34.566609 25269 raft_consensus.cc:482] T c2780c73aedb41dea02a65c3ea595d25 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:34.566809 25269 raft_consensus.cc:3037] T c2780c73aedb41dea02a65c3ea595d25 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:34.569227 25269 raft_consensus.cc:504] T c2780c73aedb41dea02a65c3ea595d25 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.569695 25269 leader_election.cc:302] T c2780c73aedb41dea02a65c3ea595d25 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:34.570008 25269 leader_election.cc:288] T c2780c73aedb41dea02a65c3ea595d25 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:34.570225 25275 raft_consensus.cc:2781] T c2780c73aedb41dea02a65c3ea595d25 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:34.570484 25275 raft_consensus.cc:686] T c2780c73aedb41dea02a65c3ea595d25 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:34.570616 25269 ts_tablet_manager.cc:1428] T c2780c73aedb41dea02a65c3ea595d25 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 18:14:34.570926 25275 consensus_queue.cc:237] T c2780c73aedb41dea02a65c3ea595d25 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.572234 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.016s user 0.006s sys 0.008s Metrics: {"bytes_written":5157,"cfile_init":1,"dirs.queue_time_us":73,"dirs.run_cpu_time_us":236,"dirs.run_wall_time_us":1322,"drs_written":1,"lbm_read_time_us":68,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1132,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:34.575321 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.221234
I20260807 18:14:34.577726 24956 catalog_manager.cc:5495] T c2780c73aedb41dea02a65c3ea595d25 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:34.615216 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.038s user 0.028s sys 0.008s Metrics: {"bytes_written":336,"cfile_cache_hit":12,"cfile_cache_hit_bytes":31020,"cfile_cache_miss":28,"cfile_cache_miss_bytes":45748,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":574,"dirs.run_cpu_time_us":1194,"dirs.run_wall_time_us":6182,"drs_written":1,"lbm_read_time_us":3192,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":59,"lbm_write_time_us":1241,"lbm_writes_lt_1ms":32,"mutex_wait_us":132,"num_input_rowsets":2,"peak_mem_usage":23145,"reinsert_count":0,"rows_written":163,"spinlock_wait_cycles":2304,"update_count":1}
I20260807 18:14:34.616945 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7079 bytes on disk
I20260807 18:14:34.617735 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":163,"lbm_reads_lt_1ms":4}
I20260807 18:14:34.623471 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49716:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.81"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:34.635630 25147 tablet_service.cc:1467] Processing CreateTablet for tablet bd4cb17f644248989e8edd7e624511be (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.81 [id=2cc774f214fc42e3b8892f6a4f433188]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:34.636175 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd4cb17f644248989e8edd7e624511be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:34.641027 25269 tablet_bootstrap.cc:492] T bd4cb17f644248989e8edd7e624511be P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:34.642983 25269 tablet_bootstrap.cc:654] T bd4cb17f644248989e8edd7e624511be P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:34.645466 25269 tablet_bootstrap.cc:492] T bd4cb17f644248989e8edd7e624511be P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:34.645602 25269 ts_tablet_manager.cc:1397] T bd4cb17f644248989e8edd7e624511be P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 18:14:34.646195 25269 raft_consensus.cc:348] T bd4cb17f644248989e8edd7e624511be P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.646440 25269 raft_consensus.cc:374] T bd4cb17f644248989e8edd7e624511be P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:34.646544 25269 raft_consensus.cc:729] T bd4cb17f644248989e8edd7e624511be P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:34.646814 25269 consensus_queue.cc:260] T bd4cb17f644248989e8edd7e624511be P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.646991 25269 raft_consensus.cc:388] T bd4cb17f644248989e8edd7e624511be P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:34.647110 25269 raft_consensus.cc:482] T bd4cb17f644248989e8edd7e624511be P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:34.647208 25269 raft_consensus.cc:3037] T bd4cb17f644248989e8edd7e624511be P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:34.649243 25269 raft_consensus.cc:504] T bd4cb17f644248989e8edd7e624511be P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.649533 25269 leader_election.cc:302] T bd4cb17f644248989e8edd7e624511be P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:34.649787 25269 leader_election.cc:288] T bd4cb17f644248989e8edd7e624511be P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:34.649797 25275 raft_consensus.cc:2781] T bd4cb17f644248989e8edd7e624511be P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:34.650038 25275 raft_consensus.cc:686] T bd4cb17f644248989e8edd7e624511be P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:34.650283 25275 consensus_queue.cc:237] T bd4cb17f644248989e8edd7e624511be P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.650527 25269 ts_tablet_manager.cc:1428] T bd4cb17f644248989e8edd7e624511be P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 18:14:34.656180 24956 catalog_manager.cc:5495] T bd4cb17f644248989e8edd7e624511be P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:34.694653 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000082
I20260807 18:14:34.697525 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49726:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.82"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:34.710877 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.016s user 0.010s sys 0.004s Metrics: {"bytes_written":6066,"cfile_init":1,"dirs.queue_time_us":64,"dirs.run_cpu_time_us":193,"dirs.run_wall_time_us":1636,"drs_written":1,"lbm_read_time_us":77,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1207,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:34.711866 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.246437
I20260807 18:14:34.712055 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 5123bb90ec19444b9cb7c4e62f08b33f (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.82 [id=7496616ef15a4e4697e286a25cd90bf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:34.712574 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5123bb90ec19444b9cb7c4e62f08b33f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:34.720119 25269 tablet_bootstrap.cc:492] T 5123bb90ec19444b9cb7c4e62f08b33f P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:34.722541 25269 tablet_bootstrap.cc:654] T 5123bb90ec19444b9cb7c4e62f08b33f P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:34.725894 25269 tablet_bootstrap.cc:492] T 5123bb90ec19444b9cb7c4e62f08b33f P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:34.726130 25269 ts_tablet_manager.cc:1397] T 5123bb90ec19444b9cb7c4e62f08b33f P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 18:14:34.727208 25269 raft_consensus.cc:348] T 5123bb90ec19444b9cb7c4e62f08b33f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.727432 25269 raft_consensus.cc:374] T 5123bb90ec19444b9cb7c4e62f08b33f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:34.727599 25269 raft_consensus.cc:729] T 5123bb90ec19444b9cb7c4e62f08b33f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:34.727859 25269 consensus_queue.cc:260] T 5123bb90ec19444b9cb7c4e62f08b33f P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.728120 25269 raft_consensus.cc:388] T 5123bb90ec19444b9cb7c4e62f08b33f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:34.728223 25269 raft_consensus.cc:482] T 5123bb90ec19444b9cb7c4e62f08b33f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:34.728336 25269 raft_consensus.cc:3037] T 5123bb90ec19444b9cb7c4e62f08b33f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:34.730759 25269 raft_consensus.cc:504] T 5123bb90ec19444b9cb7c4e62f08b33f P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.731065 25269 leader_election.cc:302] T 5123bb90ec19444b9cb7c4e62f08b33f P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:34.731302 25269 leader_election.cc:288] T 5123bb90ec19444b9cb7c4e62f08b33f P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:34.731418 25275 raft_consensus.cc:2781] T 5123bb90ec19444b9cb7c4e62f08b33f P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:34.731600 25275 raft_consensus.cc:686] T 5123bb90ec19444b9cb7c4e62f08b33f P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:34.732091 25269 ts_tablet_manager.cc:1428] T 5123bb90ec19444b9cb7c4e62f08b33f P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.005s sys 0.002s
I20260807 18:14:34.732074 25275 consensus_queue.cc:237] T 5123bb90ec19444b9cb7c4e62f08b33f P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.738655 24957 catalog_manager.cc:5495] T 5123bb90ec19444b9cb7c4e62f08b33f P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:34.742744 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.031s user 0.021s sys 0.008s Metrics: {"bytes_written":41526,"cfile_cache_hit":12,"cfile_cache_hit_bytes":31417,"cfile_cache_miss":28,"cfile_cache_miss_bytes":46517,"cfile_init":8,"delta_iterators_relevant":4,"dirs.queue_time_us":458,"dirs.run_cpu_time_us":188,"dirs.run_wall_time_us":1272,"drs_written":1,"lbm_read_time_us":1409,"lbm_reads_lt_1ms":60,"lbm_write_time_us":1142,"lbm_writes_lt_1ms":28,"mutex_wait_us":22,"num_input_rowsets":2,"peak_mem_usage":23568,"rows_written":165,"spinlock_wait_cycles":101888}
I20260807 18:14:34.743837 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000009
I20260807 18:14:34.759462 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.015s user 0.012s sys 0.002s Metrics: {"bytes_written":334,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":46,"dirs.run_cpu_time_us":192,"dirs.run_wall_time_us":4517,"drs_written":1,"lbm_read_time_us":88,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1324,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":2,"update_count":1}
I20260807 18:14:34.760352 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7423 bytes on disk
I20260807 18:14:34.761119 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":118,"lbm_reads_lt_1ms":8}
I20260807 18:14:34.761966 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.462604
I20260807 18:14:34.771092 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.009s user 0.008s sys 0.000s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":577,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":162,"lbm_read_time_us":387,"lbm_reads_lt_1ms":21,"lbm_write_time_us":339,"lbm_writes_lt_1ms":9,"mutex_wait_us":22,"reinsert_count":0,"spinlock_wait_cycles":1920,"update_count":1}
I20260807 18:14:34.772143 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.202087
I20260807 18:14:34.787726 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49742:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:34.801293 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 7977a1e155a3434fbf6fcbe972fc4166 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.83 [id=8daa4b14248f481b82257e47e456bcaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:34.801923 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7977a1e155a3434fbf6fcbe972fc4166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:34.806124 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.034s user 0.031s sys 0.001s Metrics: {"bytes_written":41955,"cfile_cache_hit":13,"cfile_cache_hit_bytes":31829,"cfile_cache_miss":31,"cfile_cache_miss_bytes":47287,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":965,"dirs.run_cpu_time_us":1250,"dirs.run_wall_time_us":6450,"drs_written":1,"lbm_read_time_us":1354,"lbm_reads_lt_1ms":63,"lbm_write_time_us":1103,"lbm_writes_lt_1ms":28,"mutex_wait_us":174,"num_input_rowsets":2,"peak_mem_usage":23841,"rows_written":167,"spinlock_wait_cycles":768,"thread_start_us":621,"threads_started":1}
I20260807 18:14:34.807099 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7277 bytes on disk
I20260807 18:14:34.807842 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":77,"lbm_reads_lt_1ms":4}
I20260807 18:14:34.808377 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000014
I20260807 18:14:34.808984 25269 tablet_bootstrap.cc:492] T 7977a1e155a3434fbf6fcbe972fc4166 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:34.810807 25269 tablet_bootstrap.cc:654] T 7977a1e155a3434fbf6fcbe972fc4166 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:34.813536 25269 tablet_bootstrap.cc:492] T 7977a1e155a3434fbf6fcbe972fc4166 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:34.813711 25269 ts_tablet_manager.cc:1397] T 7977a1e155a3434fbf6fcbe972fc4166 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 18:14:34.814440 25269 raft_consensus.cc:348] T 7977a1e155a3434fbf6fcbe972fc4166 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.814694 25269 raft_consensus.cc:374] T 7977a1e155a3434fbf6fcbe972fc4166 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:34.814790 25269 raft_consensus.cc:729] T 7977a1e155a3434fbf6fcbe972fc4166 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:34.815040 25269 consensus_queue.cc:260] T 7977a1e155a3434fbf6fcbe972fc4166 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.815244 25269 raft_consensus.cc:388] T 7977a1e155a3434fbf6fcbe972fc4166 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:34.815338 25269 raft_consensus.cc:482] T 7977a1e155a3434fbf6fcbe972fc4166 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:34.815403 25269 raft_consensus.cc:3037] T 7977a1e155a3434fbf6fcbe972fc4166 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:34.817605 25269 raft_consensus.cc:504] T 7977a1e155a3434fbf6fcbe972fc4166 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.817899 25269 leader_election.cc:302] T 7977a1e155a3434fbf6fcbe972fc4166 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:34.818217 25269 leader_election.cc:288] T 7977a1e155a3434fbf6fcbe972fc4166 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:34.818347 25275 raft_consensus.cc:2781] T 7977a1e155a3434fbf6fcbe972fc4166 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:34.818563 25275 raft_consensus.cc:686] T 7977a1e155a3434fbf6fcbe972fc4166 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:34.818739 25269 ts_tablet_manager.cc:1428] T 7977a1e155a3434fbf6fcbe972fc4166 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 18:14:34.818814 25275 consensus_queue.cc:237] T 7977a1e155a3434fbf6fcbe972fc4166 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.820251 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.009s sys 0.000s Metrics: {"bytes_written":5157,"cfile_init":1,"dirs.queue_time_us":51,"dirs.run_cpu_time_us":208,"dirs.run_wall_time_us":1425,"drs_written":1,"lbm_read_time_us":83,"lbm_reads_lt_1ms":4,"lbm_write_time_us":663,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:34.821259 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 235 bytes on disk
I20260807 18:14:34.821956 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":99,"lbm_reads_lt_1ms":4}
I20260807 18:14:34.823346 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.194024
I20260807 18:14:34.825670 24957 catalog_manager.cc:5495] T 7977a1e155a3434fbf6fcbe972fc4166 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:34.856617 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.033s user 0.029s sys 0.004s Metrics: {"bytes_written":336,"cfile_cache_hit":12,"cfile_cache_hit_bytes":32122,"cfile_cache_miss":28,"cfile_cache_miss_bytes":47370,"cfile_init":7,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":647,"dirs.run_cpu_time_us":199,"dirs.run_wall_time_us":1479,"drs_written":1,"lbm_read_time_us":1180,"lbm_reads_lt_1ms":56,"lbm_write_time_us":1276,"lbm_writes_lt_1ms":32,"mutex_wait_us":38,"num_input_rowsets":2,"peak_mem_usage":23910,"reinsert_count":0,"rows_written":169,"spinlock_wait_cycles":6528,"update_count":1}
I20260807 18:14:34.857599 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7343 bytes on disk
I20260807 18:14:34.858157 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":67,"lbm_reads_lt_1ms":4}
I20260807 18:14:34.868912 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000082
I20260807 18:14:34.876674 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49752:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.84"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:34.881670 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.010s sys 0.002s Metrics: {"bytes_written":6066,"cfile_init":1,"dirs.queue_time_us":70,"dirs.run_cpu_time_us":288,"dirs.run_wall_time_us":1487,"drs_written":1,"lbm_read_time_us":63,"lbm_reads_lt_1ms":4,"lbm_write_time_us":947,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:34.883913 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.242969
I20260807 18:14:34.891649 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 05cb083164254afca6c2e5c7c42ccb7c (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.84 [id=b21418cfbbbe4dc3b3cc9a746170a645]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:34.892254 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05cb083164254afca6c2e5c7c42ccb7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:34.899672 25269 tablet_bootstrap.cc:492] T 05cb083164254afca6c2e5c7c42ccb7c P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:34.901517 25269 tablet_bootstrap.cc:654] T 05cb083164254afca6c2e5c7c42ccb7c P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:34.904158 25269 tablet_bootstrap.cc:492] T 05cb083164254afca6c2e5c7c42ccb7c P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:34.904310 25269 ts_tablet_manager.cc:1397] T 05cb083164254afca6c2e5c7c42ccb7c P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260807 18:14:34.905082 25269 raft_consensus.cc:348] T 05cb083164254afca6c2e5c7c42ccb7c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.905241 25269 raft_consensus.cc:374] T 05cb083164254afca6c2e5c7c42ccb7c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:34.905385 25269 raft_consensus.cc:729] T 05cb083164254afca6c2e5c7c42ccb7c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:34.905685 25269 consensus_queue.cc:260] T 05cb083164254afca6c2e5c7c42ccb7c P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.906044 25269 raft_consensus.cc:388] T 05cb083164254afca6c2e5c7c42ccb7c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:34.906174 25269 raft_consensus.cc:482] T 05cb083164254afca6c2e5c7c42ccb7c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:34.906317 25269 raft_consensus.cc:3037] T 05cb083164254afca6c2e5c7c42ccb7c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:34.908792 25269 raft_consensus.cc:504] T 05cb083164254afca6c2e5c7c42ccb7c P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.909060 25269 leader_election.cc:302] T 05cb083164254afca6c2e5c7c42ccb7c P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:34.909258 25269 leader_election.cc:288] T 05cb083164254afca6c2e5c7c42ccb7c P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:34.909395 25275 raft_consensus.cc:2781] T 05cb083164254afca6c2e5c7c42ccb7c P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:34.909615 25275 raft_consensus.cc:686] T 05cb083164254afca6c2e5c7c42ccb7c P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:34.909821 25269 ts_tablet_manager.cc:1428] T 05cb083164254afca6c2e5c7c42ccb7c P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.003s sys 0.003s
I20260807 18:14:34.909930 25275 consensus_queue.cc:237] T 05cb083164254afca6c2e5c7c42ccb7c P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:34.919620 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.035s user 0.030s sys 0.004s Metrics: {"bytes_written":42400,"cfile_cache_hit":13,"cfile_cache_hit_bytes":32152,"cfile_cache_miss":31,"cfile_cache_miss_bytes":47960,"cfile_init":9,"delta_iterators_relevant":6,"dirs.queue_time_us":1063,"dirs.run_cpu_time_us":281,"dirs.run_wall_time_us":1414,"drs_written":1,"lbm_read_time_us":1611,"lbm_reads_lt_1ms":67,"lbm_write_time_us":2327,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":27,"mutex_wait_us":210,"num_input_rowsets":2,"peak_mem_usage":24126,"rows_written":169,"spinlock_wait_cycles":13440}
I20260807 18:14:34.921025 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7365 bytes on disk
I20260807 18:14:34.921679 24957 catalog_manager.cc:5495] T 05cb083164254afca6c2e5c7c42ccb7c P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:34.921995 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":138,"lbm_reads_lt_1ms":4}
I20260807 18:14:34.922669 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000011
I20260807 18:14:34.938206 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.015s user 0.008s sys 0.006s Metrics: {"bytes_written":334,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":46,"dirs.run_cpu_time_us":238,"dirs.run_wall_time_us":1455,"drs_written":1,"lbm_read_time_us":85,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1187,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":2,"update_count":1}
I20260807 18:14:34.939116 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.462604
I20260807 18:14:34.951071 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.007s sys 0.004s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":577,"cfile_init":5,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":232,"lbm_read_time_us":510,"lbm_reads_lt_1ms":25,"lbm_write_time_us":405,"lbm_writes_lt_1ms":9,"reinsert_count":0,"update_count":1}
I20260807 18:14:34.952085 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 235 bytes on disk
I20260807 18:14:34.952814 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":100,"lbm_reads_lt_1ms":4}
I20260807 18:14:34.953704 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.164671
I20260807 18:14:34.982651 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49768:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:34.999434 25147 tablet_service.cc:1467] Processing CreateTablet for tablet b092664c96e44ebd8c08d90f5bc24c79 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.85 [id=fcebc4b5d51543f79c9a0decd4427831]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:35.000048 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b092664c96e44ebd8c08d90f5bc24c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:35.007982 25269 tablet_bootstrap.cc:492] T b092664c96e44ebd8c08d90f5bc24c79 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:35.008550 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.054s user 0.028s sys 0.011s Metrics: {"bytes_written":42828,"cfile_cache_hit":13,"cfile_cache_hit_bytes":32567,"cfile_cache_miss":31,"cfile_cache_miss_bytes":48395,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":5343,"dirs.run_cpu_time_us":493,"dirs.run_wall_time_us":2826,"drs_written":1,"lbm_read_time_us":1806,"lbm_reads_lt_1ms":63,"lbm_write_time_us":1418,"lbm_writes_lt_1ms":28,"mutex_wait_us":4450,"num_input_rowsets":2,"peak_mem_usage":24071,"rows_written":171}
I20260807 18:14:35.009723 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7448 bytes on disk
I20260807 18:14:35.010605 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":120,"lbm_reads_lt_1ms":4}
I20260807 18:14:35.011309 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000020
I20260807 18:14:35.011770 25269 tablet_bootstrap.cc:654] T b092664c96e44ebd8c08d90f5bc24c79 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:35.027630 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.016s user 0.006s sys 0.007s Metrics: {"bytes_written":5157,"cfile_init":1,"dirs.queue_time_us":51,"dirs.run_cpu_time_us":151,"dirs.run_wall_time_us":1154,"drs_written":1,"lbm_read_time_us":74,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1182,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:35.028362 25269 tablet_bootstrap.cc:492] T b092664c96e44ebd8c08d90f5bc24c79 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:35.028602 25269 ts_tablet_manager.cc:1397] T b092664c96e44ebd8c08d90f5bc24c79 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.008s
I20260807 18:14:35.028726 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 235 bytes on disk
I20260807 18:14:35.029544 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":94,"lbm_reads_lt_1ms":4}
I20260807 18:14:35.029791 25269 raft_consensus.cc:348] T b092664c96e44ebd8c08d90f5bc24c79 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.030045 25269 raft_consensus.cc:374] T b092664c96e44ebd8c08d90f5bc24c79 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:35.030154 25269 raft_consensus.cc:729] T b092664c96e44ebd8c08d90f5bc24c79 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:35.030439 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.191745
I20260807 18:14:35.030447 25269 consensus_queue.cc:260] T b092664c96e44ebd8c08d90f5bc24c79 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.030839 25269 raft_consensus.cc:388] T b092664c96e44ebd8c08d90f5bc24c79 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:35.031004 25269 raft_consensus.cc:482] T b092664c96e44ebd8c08d90f5bc24c79 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:35.031118 25269 raft_consensus.cc:3037] T b092664c96e44ebd8c08d90f5bc24c79 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:35.035387 25269 raft_consensus.cc:504] T b092664c96e44ebd8c08d90f5bc24c79 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.035735 25269 leader_election.cc:302] T b092664c96e44ebd8c08d90f5bc24c79 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:35.036092 25269 leader_election.cc:288] T b092664c96e44ebd8c08d90f5bc24c79 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:35.036099 25275 raft_consensus.cc:2781] T b092664c96e44ebd8c08d90f5bc24c79 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:35.036312 25275 raft_consensus.cc:686] T b092664c96e44ebd8c08d90f5bc24c79 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:35.036572 25275 consensus_queue.cc:237] T b092664c96e44ebd8c08d90f5bc24c79 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.036888 25269 ts_tablet_manager.cc:1428] T b092664c96e44ebd8c08d90f5bc24c79 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260807 18:14:35.044059 24957 catalog_manager.cc:5495] T b092664c96e44ebd8c08d90f5bc24c79 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:35.072438 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.042s user 0.016s sys 0.019s Metrics: {"bytes_written":336,"cfile_cache_hit":12,"cfile_cache_hit_bytes":32860,"cfile_cache_miss":28,"cfile_cache_miss_bytes":48460,"cfile_init":7,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":864,"dirs.run_cpu_time_us":406,"dirs.run_wall_time_us":1949,"drs_written":1,"lbm_read_time_us":1364,"lbm_reads_lt_1ms":56,"lbm_write_time_us":1522,"lbm_writes_lt_1ms":32,"mutex_wait_us":183,"num_input_rowsets":2,"peak_mem_usage":24420,"reinsert_count":0,"rows_written":173,"spinlock_wait_cycles":768,"update_count":1}
I20260807 18:14:35.073693 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7515 bytes on disk
I20260807 18:14:35.074285 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":64,"lbm_reads_lt_1ms":4}
I20260807 18:14:35.100185 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49782:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.86"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:35.109165 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000080
I20260807 18:14:35.113305 25147 tablet_service.cc:1467] Processing CreateTablet for tablet c8abb83756ef4f68914603af9fb07695 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.86 [id=2fb37c548ac84803a6e8b50ade71a9a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:35.113965 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8abb83756ef4f68914603af9fb07695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:35.120172 25269 tablet_bootstrap.cc:492] T c8abb83756ef4f68914603af9fb07695 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:35.122321 25269 tablet_bootstrap.cc:654] T c8abb83756ef4f68914603af9fb07695 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:35.125785 25269 tablet_bootstrap.cc:492] T c8abb83756ef4f68914603af9fb07695 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:35.126041 25269 ts_tablet_manager.cc:1397] T c8abb83756ef4f68914603af9fb07695 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260807 18:14:35.127331 25269 raft_consensus.cc:348] T c8abb83756ef4f68914603af9fb07695 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.127609 25269 raft_consensus.cc:374] T c8abb83756ef4f68914603af9fb07695 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:35.127786 25269 raft_consensus.cc:729] T c8abb83756ef4f68914603af9fb07695 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:35.128057 25269 consensus_queue.cc:260] T c8abb83756ef4f68914603af9fb07695 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.128302 25269 raft_consensus.cc:388] T c8abb83756ef4f68914603af9fb07695 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:35.128415 25269 raft_consensus.cc:482] T c8abb83756ef4f68914603af9fb07695 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:35.128587 25269 raft_consensus.cc:3037] T c8abb83756ef4f68914603af9fb07695 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:35.131198 25269 raft_consensus.cc:504] T c8abb83756ef4f68914603af9fb07695 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.131557 25269 leader_election.cc:302] T c8abb83756ef4f68914603af9fb07695 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:35.131814 25269 leader_election.cc:288] T c8abb83756ef4f68914603af9fb07695 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:35.131985 25275 raft_consensus.cc:2781] T c8abb83756ef4f68914603af9fb07695 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:35.132175 25275 raft_consensus.cc:686] T c8abb83756ef4f68914603af9fb07695 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:35.132490 25275 consensus_queue.cc:237] T c8abb83756ef4f68914603af9fb07695 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.132808 25269 ts_tablet_manager.cc:1428] T c8abb83756ef4f68914603af9fb07695 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260807 18:14:35.139343 24957 catalog_manager.cc:5495] T c8abb83756ef4f68914603af9fb07695 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:35.140244 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.031s user 0.028s sys 0.000s Metrics: {"bytes_written":329,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":132,"dirs.run_cpu_time_us":253,"dirs.run_wall_time_us":2010,"drs_written":1,"lbm_read_time_us":53,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1219,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":6,"update_count":1}
I20260807 18:14:35.142232 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 464 bytes on disk
I20260807 18:14:35.142915 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":94,"lbm_reads_lt_1ms":4}
I20260807 18:14:35.144104 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.246284
I20260807 18:14:35.179700 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.035s user 0.030s sys 0.004s Metrics: {"bytes_written":336,"cfile_cache_hit":14,"cfile_cache_hit_bytes":33148,"cfile_cache_miss":34,"cfile_cache_miss_bytes":49788,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":8,"dirs.queue_time_us":1983,"dirs.run_cpu_time_us":223,"dirs.run_wall_time_us":1413,"drs_written":1,"lbm_read_time_us":1770,"lbm_reads_lt_1ms":66,"lbm_write_time_us":1322,"lbm_writes_lt_1ms":32,"mutex_wait_us":690,"num_input_rowsets":2,"peak_mem_usage":24851,"reinsert_count":0,"rows_written":175,"update_count":1}
I20260807 18:14:35.181031 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7601 bytes on disk
I20260807 18:14:35.181856 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":83,"lbm_reads_lt_1ms":4}
I20260807 18:14:35.184789 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49792:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:35.197811 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 4367b7014d154fc696d7b10733b35756 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.87 [id=eb86f72bce6b4cfe87fde1210206b6a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:35.198314 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4367b7014d154fc696d7b10733b35756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:35.203851 25269 tablet_bootstrap.cc:492] T 4367b7014d154fc696d7b10733b35756 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:35.205613 25269 tablet_bootstrap.cc:654] T 4367b7014d154fc696d7b10733b35756 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:35.208688 25269 tablet_bootstrap.cc:492] T 4367b7014d154fc696d7b10733b35756 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:35.208956 25269 ts_tablet_manager.cc:1397] T 4367b7014d154fc696d7b10733b35756 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260807 18:14:35.209867 25269 raft_consensus.cc:348] T 4367b7014d154fc696d7b10733b35756 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.210207 25269 raft_consensus.cc:374] T 4367b7014d154fc696d7b10733b35756 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:35.210354 25269 raft_consensus.cc:729] T 4367b7014d154fc696d7b10733b35756 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:35.210664 25269 consensus_queue.cc:260] T 4367b7014d154fc696d7b10733b35756 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.210866 25269 raft_consensus.cc:388] T 4367b7014d154fc696d7b10733b35756 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:35.211045 25269 raft_consensus.cc:482] T 4367b7014d154fc696d7b10733b35756 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:35.211226 25269 raft_consensus.cc:3037] T 4367b7014d154fc696d7b10733b35756 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:35.213729 25269 raft_consensus.cc:504] T 4367b7014d154fc696d7b10733b35756 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.214185 25269 leader_election.cc:302] T 4367b7014d154fc696d7b10733b35756 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:35.214560 25269 leader_election.cc:288] T 4367b7014d154fc696d7b10733b35756 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:35.214557 25275 raft_consensus.cc:2781] T 4367b7014d154fc696d7b10733b35756 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:35.214886 25275 raft_consensus.cc:686] T 4367b7014d154fc696d7b10733b35756 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:35.215294 25269 ts_tablet_manager.cc:1428] T 4367b7014d154fc696d7b10733b35756 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 18:14:35.215240 25275 consensus_queue.cc:237] T 4367b7014d154fc696d7b10733b35756 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.220738 24956 catalog_manager.cc:5495] T 4367b7014d154fc696d7b10733b35756 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:35.258961 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49808:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.88"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:35.273319 25147 tablet_service.cc:1467] Processing CreateTablet for tablet f3fe5a21cb424aac85eb2e87aa28d60a (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.88 [id=9c4a6f338bcc4b47af0c04217e1ae9a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:35.273926 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3fe5a21cb424aac85eb2e87aa28d60a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:35.280366 25269 tablet_bootstrap.cc:492] T f3fe5a21cb424aac85eb2e87aa28d60a P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:35.283080 25269 tablet_bootstrap.cc:654] T f3fe5a21cb424aac85eb2e87aa28d60a P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:35.286367 25269 tablet_bootstrap.cc:492] T f3fe5a21cb424aac85eb2e87aa28d60a P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:35.286594 25269 ts_tablet_manager.cc:1397] T f3fe5a21cb424aac85eb2e87aa28d60a P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260807 18:14:35.287613 25269 raft_consensus.cc:348] T f3fe5a21cb424aac85eb2e87aa28d60a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.287906 25269 raft_consensus.cc:374] T f3fe5a21cb424aac85eb2e87aa28d60a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:35.288108 25269 raft_consensus.cc:729] T f3fe5a21cb424aac85eb2e87aa28d60a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:35.288441 25269 consensus_queue.cc:260] T f3fe5a21cb424aac85eb2e87aa28d60a P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.288766 25269 raft_consensus.cc:388] T f3fe5a21cb424aac85eb2e87aa28d60a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:35.288908 25269 raft_consensus.cc:482] T f3fe5a21cb424aac85eb2e87aa28d60a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:35.289155 25269 raft_consensus.cc:3037] T f3fe5a21cb424aac85eb2e87aa28d60a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:35.291538 25269 raft_consensus.cc:504] T f3fe5a21cb424aac85eb2e87aa28d60a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.291797 25269 leader_election.cc:302] T f3fe5a21cb424aac85eb2e87aa28d60a P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:35.291978 25269 leader_election.cc:288] T f3fe5a21cb424aac85eb2e87aa28d60a P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:35.292174 25275 raft_consensus.cc:2781] T f3fe5a21cb424aac85eb2e87aa28d60a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:35.292379 25275 raft_consensus.cc:686] T f3fe5a21cb424aac85eb2e87aa28d60a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:35.292701 25269 ts_tablet_manager.cc:1428] T f3fe5a21cb424aac85eb2e87aa28d60a P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260807 18:14:35.292743 25275 consensus_queue.cc:237] T f3fe5a21cb424aac85eb2e87aa28d60a P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.298601 24956 catalog_manager.cc:5495] T f3fe5a21cb424aac85eb2e87aa28d60a P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:35.325423 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000083
I20260807 18:14:35.340286 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49814:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.89"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:35.343412 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.018s user 0.008s sys 0.007s Metrics: {"bytes_written":6066,"cfile_init":1,"dirs.queue_time_us":69,"dirs.run_cpu_time_us":245,"dirs.run_wall_time_us":1662,"drs_written":1,"lbm_read_time_us":129,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1260,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:35.344590 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.243321
I20260807 18:14:35.356364 25147 tablet_service.cc:1467] Processing CreateTablet for tablet a6e33b703731471f8b802666a9cfdef2 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.89 [id=8c9fc9655d9548818d1f6c97c845f058]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:35.356877 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6e33b703731471f8b802666a9cfdef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:35.361917 25269 tablet_bootstrap.cc:492] T a6e33b703731471f8b802666a9cfdef2 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:35.363883 25269 tablet_bootstrap.cc:654] T a6e33b703731471f8b802666a9cfdef2 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:35.367667 25269 tablet_bootstrap.cc:492] T a6e33b703731471f8b802666a9cfdef2 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:35.367873 25269 ts_tablet_manager.cc:1397] T a6e33b703731471f8b802666a9cfdef2 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 18:14:35.368804 25269 raft_consensus.cc:348] T a6e33b703731471f8b802666a9cfdef2 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.369102 25269 raft_consensus.cc:374] T a6e33b703731471f8b802666a9cfdef2 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:35.369221 25269 raft_consensus.cc:729] T a6e33b703731471f8b802666a9cfdef2 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:35.369665 25269 consensus_queue.cc:260] T a6e33b703731471f8b802666a9cfdef2 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.369837 25269 raft_consensus.cc:388] T a6e33b703731471f8b802666a9cfdef2 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:35.369966 25269 raft_consensus.cc:482] T a6e33b703731471f8b802666a9cfdef2 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:35.370078 25269 raft_consensus.cc:3037] T a6e33b703731471f8b802666a9cfdef2 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:35.372866 25269 raft_consensus.cc:504] T a6e33b703731471f8b802666a9cfdef2 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.373111 25269 leader_election.cc:302] T a6e33b703731471f8b802666a9cfdef2 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:35.373368 25269 leader_election.cc:288] T a6e33b703731471f8b802666a9cfdef2 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:35.373490 25275 raft_consensus.cc:2781] T a6e33b703731471f8b802666a9cfdef2 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:35.373703 25275 raft_consensus.cc:686] T a6e33b703731471f8b802666a9cfdef2 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:35.373889 25269 ts_tablet_manager.cc:1428] T a6e33b703731471f8b802666a9cfdef2 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.000s sys 0.006s
I20260807 18:14:35.373982 25275 consensus_queue.cc:237] T a6e33b703731471f8b802666a9cfdef2 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.379809 24956 catalog_manager.cc:5495] T a6e33b703731471f8b802666a9cfdef2 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:35.380715 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.036s user 0.030s sys 0.005s Metrics: {"bytes_written":44576,"cfile_cache_hit":13,"cfile_cache_hit_bytes":34002,"cfile_cache_miss":31,"cfile_cache_miss_bytes":50706,"cfile_init":9,"delta_iterators_relevant":6,"dirs.queue_time_us":989,"dirs.run_cpu_time_us":200,"dirs.run_wall_time_us":1500,"drs_written":1,"lbm_read_time_us":1401,"lbm_reads_lt_1ms":67,"lbm_write_time_us":1126,"lbm_writes_lt_1ms":28,"mutex_wait_us":106,"num_input_rowsets":2,"peak_mem_usage":25401,"rows_written":179,"spinlock_wait_cycles":1920}
I20260807 18:14:35.381997 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7776 bytes on disk
I20260807 18:14:35.382755 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":100,"lbm_reads_lt_1ms":4}
I20260807 18:14:35.383684 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000011
I20260807 18:14:35.400697 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.017s user 0.013s sys 0.000s Metrics: {"bytes_written":334,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":47,"dirs.run_cpu_time_us":222,"dirs.run_wall_time_us":1476,"drs_written":1,"lbm_read_time_us":128,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1466,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":2,"update_count":1}
I20260807 18:14:35.401950 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.462604
I20260807 18:14:35.415340 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.013s user 0.008s sys 0.004s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":577,"cfile_init":5,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":180,"lbm_read_time_us":538,"lbm_reads_lt_1ms":25,"lbm_write_time_us":478,"lbm_writes_lt_1ms":9,"mutex_wait_us":30,"reinsert_count":0,"update_count":1}
I20260807 18:14:35.416252 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 235 bytes on disk
I20260807 18:14:35.417062 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":95,"lbm_reads_lt_1ms":4}
I20260807 18:14:35.418030 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.219603
I20260807 18:14:35.424043 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49826:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:35.432966 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000081
I20260807 18:14:35.441771 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 37d3bc3b59b44988924680020863b055 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.90 [id=8cf275220c824f7e97f50f072ee3a074]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:35.442382 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37d3bc3b59b44988924680020863b055. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:35.449255 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.016s user 0.012s sys 0.000s Metrics: {"bytes_written":329,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":52,"dirs.run_cpu_time_us":199,"dirs.run_wall_time_us":2383,"drs_written":1,"lbm_read_time_us":132,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1352,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":8,"update_count":1}
I20260807 18:14:35.450429 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 539 bytes on disk
I20260807 18:14:35.450961 25269 tablet_bootstrap.cc:492] T 37d3bc3b59b44988924680020863b055 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:35.450973 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":64,"lbm_reads_lt_1ms":4}
I20260807 18:14:35.451699 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.251049
I20260807 18:14:35.454581 25269 tablet_bootstrap.cc:654] T 37d3bc3b59b44988924680020863b055 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:35.465732 25269 tablet_bootstrap.cc:492] T 37d3bc3b59b44988924680020863b055 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:35.466094 25269 ts_tablet_manager.cc:1397] T 37d3bc3b59b44988924680020863b055 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.011s
I20260807 18:14:35.466189 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.048s user 0.028s sys 0.016s Metrics: {"bytes_written":45017,"cfile_cache_hit":13,"cfile_cache_hit_bytes":34407,"cfile_cache_miss":31,"cfile_cache_miss_bytes":51051,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":1435,"dirs.run_cpu_time_us":1278,"dirs.run_wall_time_us":6575,"drs_written":1,"lbm_read_time_us":1823,"lbm_reads_lt_1ms":63,"lbm_write_time_us":1822,"lbm_writes_lt_1ms":28,"num_input_rowsets":2,"peak_mem_usage":25626,"rows_written":181,"thread_start_us":1951,"threads_started":1}
I20260807 18:14:35.467290 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7863 bytes on disk
I20260807 18:14:35.467491 25269 raft_consensus.cc:348] T 37d3bc3b59b44988924680020863b055 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.467782 25269 raft_consensus.cc:374] T 37d3bc3b59b44988924680020863b055 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:35.468083 25269 raft_consensus.cc:729] T 37d3bc3b59b44988924680020863b055 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:35.468206 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":149,"lbm_reads_lt_1ms":4}
I20260807 18:14:35.468423 25269 consensus_queue.cc:260] T 37d3bc3b59b44988924680020863b055 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.468772 25269 raft_consensus.cc:388] T 37d3bc3b59b44988924680020863b055 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:35.468955 25269 raft_consensus.cc:482] T 37d3bc3b59b44988924680020863b055 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:35.469079 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000019
I20260807 18:14:35.469365 25269 raft_consensus.cc:3037] T 37d3bc3b59b44988924680020863b055 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:35.473141 25269 raft_consensus.cc:504] T 37d3bc3b59b44988924680020863b055 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.473567 25269 leader_election.cc:302] T 37d3bc3b59b44988924680020863b055 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:35.474018 25269 leader_election.cc:288] T 37d3bc3b59b44988924680020863b055 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:35.474217 25275 raft_consensus.cc:2781] T 37d3bc3b59b44988924680020863b055 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:35.474509 25275 raft_consensus.cc:686] T 37d3bc3b59b44988924680020863b055 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:35.474711 25269 ts_tablet_manager.cc:1428] T 37d3bc3b59b44988924680020863b055 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.008s user 0.003s sys 0.004s
I20260807 18:14:35.474963 25275 consensus_queue.cc:237] T 37d3bc3b59b44988924680020863b055 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.487233 24956 catalog_manager.cc:5495] T 37d3bc3b59b44988924680020863b055 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:35.488866 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.019s user 0.010s sys 0.005s Metrics: {"bytes_written":5157,"cfile_init":1,"dirs.queue_time_us":5381,"dirs.run_cpu_time_us":187,"dirs.run_wall_time_us":2141,"drs_written":1,"lbm_read_time_us":135,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1459,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:35.490145 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 235 bytes on disk
I20260807 18:14:35.491024 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":120,"lbm_reads_lt_1ms":4}
I20260807 18:14:35.491973 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.190195
I20260807 18:14:35.494858 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.043s user 0.019s sys 0.018s Metrics: {"bytes_written":45408,"cfile_cache_hit":14,"cfile_cache_hit_bytes":34612,"cfile_cache_miss":34,"cfile_cache_miss_bytes":51914,"cfile_init":9,"delta_iterators_relevant":8,"dirs.queue_time_us":1309,"dirs.run_cpu_time_us":1008,"dirs.run_wall_time_us":6340,"drs_written":1,"lbm_read_time_us":1268,"lbm_reads_lt_1ms":70,"lbm_write_time_us":1490,"lbm_writes_lt_1ms":28,"mutex_wait_us":145,"num_input_rowsets":2,"peak_mem_usage":25869,"rows_written":183}
I20260807 18:14:35.495750 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7927 bytes on disk
I20260807 18:14:35.496443 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":186,"lbm_reads_lt_1ms":4}
I20260807 18:14:35.497133 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.000001
I20260807 18:14:35.502826 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.005s user 0.004s sys 0.000s Metrics: {"bytes_written":336,"delete_count":0,"lbm_write_time_us":196,"lbm_writes_lt_1ms":4,"reinsert_count":0,"update_count":1}
I20260807 18:14:35.548202 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49832:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.91"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:35.548151 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.056s user 0.038s sys 0.015s Metrics: {"bytes_written":336,"cfile_cache_hit":12,"cfile_cache_hit_bytes":34710,"cfile_cache_miss":28,"cfile_cache_miss_bytes":51146,"cfile_init":7,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":703,"dirs.run_cpu_time_us":223,"dirs.run_wall_time_us":1283,"drs_written":1,"lbm_read_time_us":1340,"lbm_reads_lt_1ms":56,"lbm_write_time_us":1833,"lbm_writes_lt_1ms":32,"mutex_wait_us":101,"num_input_rowsets":2,"peak_mem_usage":25695,"reinsert_count":0,"rows_written":183,"spinlock_wait_cycles":5376,"update_count":1}
I20260807 18:14:35.549571 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7927 bytes on disk
I20260807 18:14:35.550194 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":69,"lbm_reads_lt_1ms":4}
I20260807 18:14:35.562384 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 6df0057ca8fd4f18982cc8e3d5a5c178 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.91 [id=adb3d020b95f4644a802a1fef9543be0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:35.562861 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6df0057ca8fd4f18982cc8e3d5a5c178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:35.567924 25269 tablet_bootstrap.cc:492] T 6df0057ca8fd4f18982cc8e3d5a5c178 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:35.570441 25269 tablet_bootstrap.cc:654] T 6df0057ca8fd4f18982cc8e3d5a5c178 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:35.574476 25269 tablet_bootstrap.cc:492] T 6df0057ca8fd4f18982cc8e3d5a5c178 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:35.574724 25269 ts_tablet_manager.cc:1397] T 6df0057ca8fd4f18982cc8e3d5a5c178 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.004s
I20260807 18:14:35.575650 25269 raft_consensus.cc:348] T 6df0057ca8fd4f18982cc8e3d5a5c178 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.575992 25269 raft_consensus.cc:374] T 6df0057ca8fd4f18982cc8e3d5a5c178 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:35.576124 25269 raft_consensus.cc:729] T 6df0057ca8fd4f18982cc8e3d5a5c178 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:35.576524 25269 consensus_queue.cc:260] T 6df0057ca8fd4f18982cc8e3d5a5c178 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.576807 25269 raft_consensus.cc:388] T 6df0057ca8fd4f18982cc8e3d5a5c178 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:35.576987 25269 raft_consensus.cc:482] T 6df0057ca8fd4f18982cc8e3d5a5c178 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:35.577155 25269 raft_consensus.cc:3037] T 6df0057ca8fd4f18982cc8e3d5a5c178 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:35.579718 25269 raft_consensus.cc:504] T 6df0057ca8fd4f18982cc8e3d5a5c178 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.580001 25269 leader_election.cc:302] T 6df0057ca8fd4f18982cc8e3d5a5c178 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:35.580317 25269 leader_election.cc:288] T 6df0057ca8fd4f18982cc8e3d5a5c178 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:35.580365 25275 raft_consensus.cc:2781] T 6df0057ca8fd4f18982cc8e3d5a5c178 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:35.580668 25275 raft_consensus.cc:686] T 6df0057ca8fd4f18982cc8e3d5a5c178 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:35.580973 25269 ts_tablet_manager.cc:1428] T 6df0057ca8fd4f18982cc8e3d5a5c178 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260807 18:14:35.580969 25275 consensus_queue.cc:237] T 6df0057ca8fd4f18982cc8e3d5a5c178 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.587285 24956 catalog_manager.cc:5495] T 6df0057ca8fd4f18982cc8e3d5a5c178 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:35.634548 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49836:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.92"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:35.648196 25147 tablet_service.cc:1467] Processing CreateTablet for tablet b6f56c30e8e74e6883627143b2b962b0 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.92 [id=e74e4f0c915a4c37b284636b52653f9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:35.648787 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6f56c30e8e74e6883627143b2b962b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:35.654636 25269 tablet_bootstrap.cc:492] T b6f56c30e8e74e6883627143b2b962b0 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:35.656731 25269 tablet_bootstrap.cc:654] T b6f56c30e8e74e6883627143b2b962b0 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:35.660244 25269 tablet_bootstrap.cc:492] T b6f56c30e8e74e6883627143b2b962b0 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:35.660434 25269 ts_tablet_manager.cc:1397] T b6f56c30e8e74e6883627143b2b962b0 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260807 18:14:35.661386 25269 raft_consensus.cc:348] T b6f56c30e8e74e6883627143b2b962b0 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.661616 25269 raft_consensus.cc:374] T b6f56c30e8e74e6883627143b2b962b0 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:35.661770 25269 raft_consensus.cc:729] T b6f56c30e8e74e6883627143b2b962b0 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:35.662017 25269 consensus_queue.cc:260] T b6f56c30e8e74e6883627143b2b962b0 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.662292 25269 raft_consensus.cc:388] T b6f56c30e8e74e6883627143b2b962b0 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:35.662432 25269 raft_consensus.cc:482] T b6f56c30e8e74e6883627143b2b962b0 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:35.662609 25269 raft_consensus.cc:3037] T b6f56c30e8e74e6883627143b2b962b0 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:35.665710 25269 raft_consensus.cc:504] T b6f56c30e8e74e6883627143b2b962b0 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.666062 25269 leader_election.cc:302] T b6f56c30e8e74e6883627143b2b962b0 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:35.666294 25269 leader_election.cc:288] T b6f56c30e8e74e6883627143b2b962b0 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:35.666461 25275 raft_consensus.cc:2781] T b6f56c30e8e74e6883627143b2b962b0 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:35.666729 25275 raft_consensus.cc:686] T b6f56c30e8e74e6883627143b2b962b0 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:35.667155 25269 ts_tablet_manager.cc:1428] T b6f56c30e8e74e6883627143b2b962b0 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 18:14:35.667225 25275 consensus_queue.cc:237] T b6f56c30e8e74e6883627143b2b962b0 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.673417 24956 catalog_manager.cc:5495] T b6f56c30e8e74e6883627143b2b962b0 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:35.708070 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49846:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:35.720427 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 6953400eab884694bb4d93199ed4150f (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.93 [id=b4aa4cd7738447eb8b029e9792016052]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:35.720896 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6953400eab884694bb4d93199ed4150f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:35.726907 25269 tablet_bootstrap.cc:492] T 6953400eab884694bb4d93199ed4150f P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:35.729239 25269 tablet_bootstrap.cc:654] T 6953400eab884694bb4d93199ed4150f P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:35.733297 25269 tablet_bootstrap.cc:492] T 6953400eab884694bb4d93199ed4150f P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:35.733568 25269 ts_tablet_manager.cc:1397] T 6953400eab884694bb4d93199ed4150f P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 18:14:35.734483 25269 raft_consensus.cc:348] T 6953400eab884694bb4d93199ed4150f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.734702 25269 raft_consensus.cc:374] T 6953400eab884694bb4d93199ed4150f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:35.734781 25269 raft_consensus.cc:729] T 6953400eab884694bb4d93199ed4150f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:35.735072 25269 consensus_queue.cc:260] T 6953400eab884694bb4d93199ed4150f P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.735247 25269 raft_consensus.cc:388] T 6953400eab884694bb4d93199ed4150f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:35.735347 25269 raft_consensus.cc:482] T 6953400eab884694bb4d93199ed4150f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:35.735425 25269 raft_consensus.cc:3037] T 6953400eab884694bb4d93199ed4150f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:35.737860 25269 raft_consensus.cc:504] T 6953400eab884694bb4d93199ed4150f P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.738149 25269 leader_election.cc:302] T 6953400eab884694bb4d93199ed4150f P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:35.738456 25269 leader_election.cc:288] T 6953400eab884694bb4d93199ed4150f P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:35.738562 25275 raft_consensus.cc:2781] T 6953400eab884694bb4d93199ed4150f P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:35.738945 25275 raft_consensus.cc:686] T 6953400eab884694bb4d93199ed4150f P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:35.739118 25269 ts_tablet_manager.cc:1428] T 6953400eab884694bb4d93199ed4150f P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 18:14:35.739316 25275 consensus_queue.cc:237] T 6953400eab884694bb4d93199ed4150f P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.746379 24956 catalog_manager.cc:5495] T 6953400eab884694bb4d93199ed4150f P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:35.753674 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000085
I20260807 18:14:35.768093 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.014s user 0.011s sys 0.000s Metrics: {"bytes_written":6065,"cfile_init":1,"dirs.queue_time_us":60,"dirs.run_cpu_time_us":247,"dirs.run_wall_time_us":1510,"drs_written":1,"lbm_read_time_us":73,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1021,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:35.768841 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 517 bytes on disk
I20260807 18:14:35.769449 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":71,"lbm_reads_lt_1ms":4}
I20260807 18:14:35.769989 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.210782
I20260807 18:14:35.793533 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49848:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:35.801193 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000087
I20260807 18:14:35.812080 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 5cf6a9f0a62c4bb094562c875cf79250 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.94 [id=9a6c50dd38864c34833b872950f4e346]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:35.812664 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cf6a9f0a62c4bb094562c875cf79250. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:35.812742 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.042s user 0.032s sys 0.004s Metrics: {"bytes_written":46762,"cfile_cache_hit":13,"cfile_cache_hit_bytes":35842,"cfile_cache_miss":31,"cfile_cache_miss_bytes":53368,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":1064,"dirs.run_cpu_time_us":262,"dirs.run_wall_time_us":1312,"drs_written":1,"lbm_read_time_us":1736,"lbm_reads_lt_1ms":63,"lbm_write_time_us":1565,"lbm_writes_lt_1ms":28,"num_input_rowsets":2,"peak_mem_usage":26676,"rows_written":189}
I20260807 18:14:35.813656 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8197 bytes on disk
I20260807 18:14:35.814584 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":117,"lbm_reads_lt_1ms":4}
I20260807 18:14:35.815150 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000013
I20260807 18:14:35.817852 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.016s user 0.012s sys 0.001s Metrics: {"bytes_written":6065,"cfile_init":1,"dirs.queue_time_us":74,"dirs.run_cpu_time_us":217,"dirs.run_wall_time_us":1711,"drs_written":1,"lbm_read_time_us":119,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1286,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:35.818753 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.210782
I20260807 18:14:35.821677 25269 tablet_bootstrap.cc:492] T 5cf6a9f0a62c4bb094562c875cf79250 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:35.823685 25269 tablet_bootstrap.cc:654] T 5cf6a9f0a62c4bb094562c875cf79250 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:35.827492 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.009s sys 0.000s Metrics: {"bytes_written":5157,"cfile_init":1,"dirs.queue_time_us":70,"dirs.run_cpu_time_us":208,"dirs.run_wall_time_us":1394,"drs_written":1,"lbm_read_time_us":69,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1812,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:35.828366 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 235 bytes on disk
I20260807 18:14:35.829036 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":66,"lbm_reads_lt_1ms":4}
I20260807 18:14:35.829833 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.190233
I20260807 18:14:35.831049 25269 tablet_bootstrap.cc:492] T 5cf6a9f0a62c4bb094562c875cf79250 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:35.831276 25269 ts_tablet_manager.cc:1397] T 5cf6a9f0a62c4bb094562c875cf79250 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.008s
I20260807 18:14:35.832995 25269 raft_consensus.cc:348] T 5cf6a9f0a62c4bb094562c875cf79250 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.833371 25269 raft_consensus.cc:374] T 5cf6a9f0a62c4bb094562c875cf79250 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:35.833560 25269 raft_consensus.cc:729] T 5cf6a9f0a62c4bb094562c875cf79250 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:35.833859 25269 consensus_queue.cc:260] T 5cf6a9f0a62c4bb094562c875cf79250 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.834143 25269 raft_consensus.cc:388] T 5cf6a9f0a62c4bb094562c875cf79250 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:35.834250 25269 raft_consensus.cc:482] T 5cf6a9f0a62c4bb094562c875cf79250 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:35.834417 25269 raft_consensus.cc:3037] T 5cf6a9f0a62c4bb094562c875cf79250 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:35.838011 25269 raft_consensus.cc:504] T 5cf6a9f0a62c4bb094562c875cf79250 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.838426 25269 leader_election.cc:302] T 5cf6a9f0a62c4bb094562c875cf79250 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:35.838902 25275 raft_consensus.cc:2781] T 5cf6a9f0a62c4bb094562c875cf79250 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:35.839155 25275 raft_consensus.cc:686] T 5cf6a9f0a62c4bb094562c875cf79250 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:35.839576 25275 consensus_queue.cc:237] T 5cf6a9f0a62c4bb094562c875cf79250 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.840117 25269 leader_election.cc:288] T 5cf6a9f0a62c4bb094562c875cf79250 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:35.840683 25269 ts_tablet_manager.cc:1428] T 5cf6a9f0a62c4bb094562c875cf79250 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.009s user 0.000s sys 0.007s
I20260807 18:14:35.847689 24956 catalog_manager.cc:5495] T 5cf6a9f0a62c4bb094562c875cf79250 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:35.856886 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.038s user 0.033s sys 0.000s Metrics: {"bytes_written":46762,"cfile_cache_hit":13,"cfile_cache_hit_bytes":35842,"cfile_cache_miss":31,"cfile_cache_miss_bytes":53368,"cfile_init":9,"delta_iterators_relevant":6,"dirs.queue_time_us":2537,"dirs.run_cpu_time_us":199,"dirs.run_wall_time_us":4466,"drs_written":1,"lbm_read_time_us":1612,"lbm_reads_lt_1ms":67,"lbm_write_time_us":1518,"lbm_writes_lt_1ms":28,"num_input_rowsets":2,"peak_mem_usage":26676,"rows_written":189}
I20260807 18:14:35.857935 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8197 bytes on disk
I20260807 18:14:35.858763 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":83,"lbm_reads_lt_1ms":4}
I20260807 18:14:35.859779 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000012
I20260807 18:14:35.872246 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.042s user 0.029s sys 0.008s Metrics: {"bytes_written":333,"cfile_cache_hit":12,"cfile_cache_hit_bytes":36186,"cfile_cache_miss":28,"cfile_cache_miss_bytes":53302,"cfile_init":7,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":517,"dirs.run_cpu_time_us":189,"dirs.run_wall_time_us":1384,"drs_written":1,"lbm_read_time_us":983,"lbm_reads_lt_1ms":56,"lbm_write_time_us":1758,"lbm_writes_lt_1ms":32,"mutex_wait_us":23,"num_input_rowsets":2,"peak_mem_usage":26715,"reinsert_count":0,"rows_written":191,"spinlock_wait_cycles":12032,"update_count":1}
I20260807 18:14:35.873268 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8257 bytes on disk
I20260807 18:14:35.873914 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":78,"lbm_reads_lt_1ms":4}
I20260807 18:14:35.874433 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.000002
I20260807 18:14:35.876889 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.017s user 0.011s sys 0.001s Metrics: {"bytes_written":334,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":77,"dirs.run_cpu_time_us":202,"dirs.run_wall_time_us":1162,"drs_written":1,"lbm_read_time_us":75,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1795,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":2,"update_count":1}
I20260807 18:14:35.879482 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 358 bytes on disk
I20260807 18:14:35.879791 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.005s user 0.003s sys 0.000s Metrics: {"bytes_written":336,"delete_count":0,"lbm_write_time_us":140,"lbm_writes_lt_1ms":4,"reinsert_count":0,"update_count":1}
I20260807 18:14:35.880155 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":98,"lbm_reads_lt_1ms":4}
I20260807 18:14:35.880369 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260807 18:14:35.880934 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.441799
I20260807 18:14:35.888592 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.008s user 0.004s sys 0.001s Metrics: {"cfile_cache_miss":4,"cfile_cache_miss_bytes":467,"cfile_init":1,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":110,"lbm_read_time_us":219,"lbm_reads_lt_1ms":8,"lbm_write_time_us":259,"lbm_writes_lt_1ms":4,"reinsert_count":0,"update_count":2}
I20260807 18:14:35.892120 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.010s user 0.009s sys 0.000s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":611,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":215,"lbm_read_time_us":500,"lbm_reads_lt_1ms":21,"lbm_write_time_us":448,"lbm_writes_lt_1ms":9,"mutex_wait_us":58,"reinsert_count":0,"spinlock_wait_cycles":2816,"update_count":1}
I20260807 18:14:35.892716 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.198385
I20260807 18:14:35.915772 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49852:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:35.926553 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.034s user 0.024s sys 0.008s Metrics: {"bytes_written":47192,"cfile_cache_hit":13,"cfile_cache_hit_bytes":36258,"cfile_cache_miss":31,"cfile_cache_miss_bytes":54008,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":1255,"dirs.run_cpu_time_us":242,"dirs.run_wall_time_us":1315,"drs_written":1,"lbm_read_time_us":1427,"lbm_reads_lt_1ms":63,"lbm_write_time_us":1221,"lbm_writes_lt_1ms":28,"mutex_wait_us":2,"num_input_rowsets":2,"peak_mem_usage":27104,"rows_written":191}
I20260807 18:14:35.927814 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000014
I20260807 18:14:35.929016 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 7f3b793726d1414696053b5e7561f60e (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.95 [id=176171045eba4fde9574758b56553693]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:35.929603 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f3b793726d1414696053b5e7561f60e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:35.937604 25269 tablet_bootstrap.cc:492] T 7f3b793726d1414696053b5e7561f60e P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:35.940024 25269 tablet_bootstrap.cc:654] T 7f3b793726d1414696053b5e7561f60e P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:35.941972 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.013s user 0.010s sys 0.003s Metrics: {"bytes_written":5157,"cfile_init":1,"dirs.queue_time_us":86,"dirs.run_cpu_time_us":234,"dirs.run_wall_time_us":1240,"drs_written":1,"lbm_read_time_us":132,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1189,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2,"spinlock_wait_cycles":13440}
I20260807 18:14:35.942689 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8525 bytes on disk
I20260807 18:14:35.943280 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":113,"lbm_reads_lt_1ms":8}
I20260807 18:14:35.943791 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.196358
I20260807 18:14:35.957182 25269 tablet_bootstrap.cc:492] T 7f3b793726d1414696053b5e7561f60e P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:35.957485 25269 ts_tablet_manager.cc:1397] T 7f3b793726d1414696053b5e7561f60e P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.013s
I20260807 18:14:35.958777 25269 raft_consensus.cc:348] T 7f3b793726d1414696053b5e7561f60e P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.959146 25269 raft_consensus.cc:374] T 7f3b793726d1414696053b5e7561f60e P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:35.959311 25269 raft_consensus.cc:729] T 7f3b793726d1414696053b5e7561f60e P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:35.959681 25269 consensus_queue.cc:260] T 7f3b793726d1414696053b5e7561f60e P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.959934 25269 raft_consensus.cc:388] T 7f3b793726d1414696053b5e7561f60e P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:35.960083 25269 raft_consensus.cc:482] T 7f3b793726d1414696053b5e7561f60e P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:35.960353 25269 raft_consensus.cc:3037] T 7f3b793726d1414696053b5e7561f60e P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:35.964089 25269 raft_consensus.cc:504] T 7f3b793726d1414696053b5e7561f60e P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.964500 25269 leader_election.cc:302] T 7f3b793726d1414696053b5e7561f60e P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:35.964823 25275 raft_consensus.cc:2781] T 7f3b793726d1414696053b5e7561f60e P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:35.965152 25275 raft_consensus.cc:686] T 7f3b793726d1414696053b5e7561f60e P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:35.965569 25275 consensus_queue.cc:237] T 7f3b793726d1414696053b5e7561f60e P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:35.966688 25269 leader_election.cc:288] T 7f3b793726d1414696053b5e7561f60e P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:35.967320 25269 ts_tablet_manager.cc:1428] T 7f3b793726d1414696053b5e7561f60e P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260807 18:14:35.974924 24956 catalog_manager.cc:5495] T 7f3b793726d1414696053b5e7561f60e P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:35.978323 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.034s user 0.023s sys 0.007s Metrics: {"bytes_written":47604,"cfile_cache_hit":12,"cfile_cache_hit_bytes":36550,"cfile_cache_miss":28,"cfile_cache_miss_bytes":53852,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":924,"dirs.run_cpu_time_us":854,"dirs.run_wall_time_us":5037,"drs_written":1,"lbm_read_time_us":1064,"lbm_reads_lt_1ms":56,"lbm_write_time_us":1368,"lbm_writes_lt_1ms":28,"mutex_wait_us":185,"num_input_rowsets":2,"peak_mem_usage":27174,"rows_written":193}
I20260807 18:14:35.979702 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8369 bytes on disk
I20260807 18:14:35.980334 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":97,"lbm_reads_lt_1ms":4}
I20260807 18:14:36.040575 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49860:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.96"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:36.052466 25147 tablet_service.cc:1467] Processing CreateTablet for tablet e81670670255465db720389f7ca4ee58 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.96 [id=4d3b2c5cb6d64657b38309ae965a20d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:36.053012 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e81670670255465db720389f7ca4ee58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:36.058771 25269 tablet_bootstrap.cc:492] T e81670670255465db720389f7ca4ee58 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:36.061208 25269 tablet_bootstrap.cc:654] T e81670670255465db720389f7ca4ee58 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:36.064582 25269 tablet_bootstrap.cc:492] T e81670670255465db720389f7ca4ee58 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:36.064767 25269 ts_tablet_manager.cc:1397] T e81670670255465db720389f7ca4ee58 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 18:14:36.065805 25269 raft_consensus.cc:348] T e81670670255465db720389f7ca4ee58 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.066097 25269 raft_consensus.cc:374] T e81670670255465db720389f7ca4ee58 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:36.066355 25269 raft_consensus.cc:729] T e81670670255465db720389f7ca4ee58 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:36.066740 25269 consensus_queue.cc:260] T e81670670255465db720389f7ca4ee58 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.067058 25269 raft_consensus.cc:388] T e81670670255465db720389f7ca4ee58 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:36.067212 25269 raft_consensus.cc:482] T e81670670255465db720389f7ca4ee58 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:36.067463 25269 raft_consensus.cc:3037] T e81670670255465db720389f7ca4ee58 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:36.070519 25269 raft_consensus.cc:504] T e81670670255465db720389f7ca4ee58 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.070840 25269 leader_election.cc:302] T e81670670255465db720389f7ca4ee58 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:36.071106 25269 leader_election.cc:288] T e81670670255465db720389f7ca4ee58 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:36.071296 25275 raft_consensus.cc:2781] T e81670670255465db720389f7ca4ee58 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:36.071497 25275 raft_consensus.cc:686] T e81670670255465db720389f7ca4ee58 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:36.072044 25269 ts_tablet_manager.cc:1428] T e81670670255465db720389f7ca4ee58 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 18:14:36.072002 25275 consensus_queue.cc:237] T e81670670255465db720389f7ca4ee58 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.078790 24957 catalog_manager.cc:5495] T e81670670255465db720389f7ca4ee58 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:36.118355 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49872:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:36.131039 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 696a9c013fad403186d645dec9d3d78a (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.97 [id=7ceb181c663a4725aa8186a3ea87ba64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:36.131659 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 696a9c013fad403186d645dec9d3d78a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:36.136821 25269 tablet_bootstrap.cc:492] T 696a9c013fad403186d645dec9d3d78a P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:36.138537 25269 tablet_bootstrap.cc:654] T 696a9c013fad403186d645dec9d3d78a P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:36.139562 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000087
I20260807 18:14:36.140888 25269 tablet_bootstrap.cc:492] T 696a9c013fad403186d645dec9d3d78a P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:36.141093 25269 ts_tablet_manager.cc:1397] T 696a9c013fad403186d645dec9d3d78a P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260807 18:14:36.142179 25269 raft_consensus.cc:348] T 696a9c013fad403186d645dec9d3d78a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.142416 25269 raft_consensus.cc:374] T 696a9c013fad403186d645dec9d3d78a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:36.142516 25269 raft_consensus.cc:729] T 696a9c013fad403186d645dec9d3d78a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:36.142771 25269 consensus_queue.cc:260] T 696a9c013fad403186d645dec9d3d78a P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.142992 25269 raft_consensus.cc:388] T 696a9c013fad403186d645dec9d3d78a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:36.143106 25269 raft_consensus.cc:482] T 696a9c013fad403186d645dec9d3d78a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:36.143204 25269 raft_consensus.cc:3037] T 696a9c013fad403186d645dec9d3d78a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:36.145991 25269 raft_consensus.cc:504] T 696a9c013fad403186d645dec9d3d78a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.146262 25269 leader_election.cc:302] T 696a9c013fad403186d645dec9d3d78a P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:36.146497 25269 leader_election.cc:288] T 696a9c013fad403186d645dec9d3d78a P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:36.146571 25275 raft_consensus.cc:2781] T 696a9c013fad403186d645dec9d3d78a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:36.146811 25275 raft_consensus.cc:686] T 696a9c013fad403186d645dec9d3d78a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:36.147089 25275 consensus_queue.cc:237] T 696a9c013fad403186d645dec9d3d78a P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.147230 25269 ts_tablet_manager.cc:1428] T 696a9c013fad403186d645dec9d3d78a P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.004s sys 0.003s
I20260807 18:14:36.152983 24957 catalog_manager.cc:5495] T 696a9c013fad403186d645dec9d3d78a P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:36.154950 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.015s user 0.011s sys 0.000s Metrics: {"bytes_written":6029,"cfile_init":1,"dirs.queue_time_us":64,"dirs.run_cpu_time_us":235,"dirs.run_wall_time_us":4610,"drs_written":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1051,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:36.155761 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 531 bytes on disk
I20260807 18:14:36.156458 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":88,"lbm_reads_lt_1ms":4}
I20260807 18:14:36.157162 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.239664
I20260807 18:14:36.195667 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.036s user 0.031s sys 0.000s Metrics: {"bytes_written":48510,"cfile_cache_hit":13,"cfile_cache_hit_bytes":37281,"cfile_cache_miss":31,"cfile_cache_miss_bytes":55613,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":1547,"dirs.run_cpu_time_us":259,"dirs.run_wall_time_us":1599,"drs_written":1,"lbm_read_time_us":1718,"lbm_reads_lt_1ms":63,"lbm_write_time_us":3167,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":27,"mutex_wait_us":43,"num_input_rowsets":2,"peak_mem_usage":27932,"rows_written":197}
I20260807 18:14:36.196430 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8556 bytes on disk
I20260807 18:14:36.196980 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":103,"lbm_reads_lt_1ms":4}
I20260807 18:14:36.197908 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49880:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.98"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:36.209816 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 64e8d8f571494bef9169ad0b8ae799ae (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.98 [id=b45207987f214399b9d0845110a5fbd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:36.210379 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64e8d8f571494bef9169ad0b8ae799ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:36.216187 25269 tablet_bootstrap.cc:492] T 64e8d8f571494bef9169ad0b8ae799ae P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:36.218621 25269 tablet_bootstrap.cc:654] T 64e8d8f571494bef9169ad0b8ae799ae P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:36.221865 25269 tablet_bootstrap.cc:492] T 64e8d8f571494bef9169ad0b8ae799ae P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:36.221992 25269 ts_tablet_manager.cc:1397] T 64e8d8f571494bef9169ad0b8ae799ae P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260807 18:14:36.222622 25269 raft_consensus.cc:348] T 64e8d8f571494bef9169ad0b8ae799ae P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.222782 25269 raft_consensus.cc:374] T 64e8d8f571494bef9169ad0b8ae799ae P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:36.222852 25269 raft_consensus.cc:729] T 64e8d8f571494bef9169ad0b8ae799ae P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:36.223076 25269 consensus_queue.cc:260] T 64e8d8f571494bef9169ad0b8ae799ae P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.223248 25269 raft_consensus.cc:388] T 64e8d8f571494bef9169ad0b8ae799ae P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:36.223317 25269 raft_consensus.cc:482] T 64e8d8f571494bef9169ad0b8ae799ae P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:36.223397 25269 raft_consensus.cc:3037] T 64e8d8f571494bef9169ad0b8ae799ae P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:36.225190 25269 raft_consensus.cc:504] T 64e8d8f571494bef9169ad0b8ae799ae P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.225473 25269 leader_election.cc:302] T 64e8d8f571494bef9169ad0b8ae799ae P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:36.225680 25269 leader_election.cc:288] T 64e8d8f571494bef9169ad0b8ae799ae P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:36.225838 25275 raft_consensus.cc:2781] T 64e8d8f571494bef9169ad0b8ae799ae P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:36.226051 25275 raft_consensus.cc:686] T 64e8d8f571494bef9169ad0b8ae799ae P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:36.226275 25269 ts_tablet_manager.cc:1428] T 64e8d8f571494bef9169ad0b8ae799ae P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260807 18:14:36.226344 25275 consensus_queue.cc:237] T 64e8d8f571494bef9169ad0b8ae799ae P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.231390 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000080
I20260807 18:14:36.233083 24957 catalog_manager.cc:5495] T 64e8d8f571494bef9169ad0b8ae799ae P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:36.249768 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.018s user 0.013s sys 0.003s Metrics: {"bytes_written":336,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":59,"dirs.run_cpu_time_us":258,"dirs.run_wall_time_us":1470,"drs_written":1,"lbm_read_time_us":896,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3007,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":30,"peak_mem_usage":0,"reinsert_count":0,"rows_written":6,"update_count":1}
I20260807 18:14:36.250588 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.244507
I20260807 18:14:36.277695 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49888:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.99"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:36.294662 25147 tablet_service.cc:1467] Processing CreateTablet for tablet c261a6be40f14abcb58a05c73a693342 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.99 [id=4a2be387b0a94e38bc4f84d52b2c264a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:36.295308 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c261a6be40f14abcb58a05c73a693342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:36.296730 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.046s user 0.035s sys 0.009s Metrics: {"bytes_written":48937,"cfile_cache_hit":13,"cfile_cache_hit_bytes":37655,"cfile_cache_miss":31,"cfile_cache_miss_bytes":56065,"cfile_init":9,"delta_iterators_relevant":6,"dirs.queue_time_us":1014,"dirs.run_cpu_time_us":786,"dirs.run_wall_time_us":3999,"drs_written":1,"lbm_read_time_us":1288,"lbm_reads_lt_1ms":67,"lbm_write_time_us":1558,"lbm_writes_lt_1ms":28,"mutex_wait_us":344,"num_input_rowsets":2,"peak_mem_usage":27989,"rows_written":199,"spinlock_wait_cycles":2304}
I20260807 18:14:36.297767 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8639 bytes on disk
I20260807 18:14:36.298310 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":67,"lbm_reads_lt_1ms":4}
I20260807 18:14:36.298942 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000014
I20260807 18:14:36.301110 25269 tablet_bootstrap.cc:492] T c261a6be40f14abcb58a05c73a693342 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:36.303299 25269 tablet_bootstrap.cc:654] T c261a6be40f14abcb58a05c73a693342 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:36.306545 25269 tablet_bootstrap.cc:492] T c261a6be40f14abcb58a05c73a693342 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:36.306752 25269 ts_tablet_manager.cc:1397] T c261a6be40f14abcb58a05c73a693342 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260807 18:14:36.307686 25269 raft_consensus.cc:348] T c261a6be40f14abcb58a05c73a693342 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.307937 25269 raft_consensus.cc:374] T c261a6be40f14abcb58a05c73a693342 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:36.308027 25269 raft_consensus.cc:729] T c261a6be40f14abcb58a05c73a693342 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:36.308280 25269 consensus_queue.cc:260] T c261a6be40f14abcb58a05c73a693342 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.308490 25269 raft_consensus.cc:388] T c261a6be40f14abcb58a05c73a693342 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:36.308611 25269 raft_consensus.cc:482] T c261a6be40f14abcb58a05c73a693342 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:36.308712 25269 raft_consensus.cc:3037] T c261a6be40f14abcb58a05c73a693342 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:36.311672 25269 raft_consensus.cc:504] T c261a6be40f14abcb58a05c73a693342 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.311945 25269 leader_election.cc:302] T c261a6be40f14abcb58a05c73a693342 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:36.312251 25269 leader_election.cc:288] T c261a6be40f14abcb58a05c73a693342 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:36.312412 25275 raft_consensus.cc:2781] T c261a6be40f14abcb58a05c73a693342 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:36.312671 25275 raft_consensus.cc:686] T c261a6be40f14abcb58a05c73a693342 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:36.312863 25269 ts_tablet_manager.cc:1428] T c261a6be40f14abcb58a05c73a693342 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260807 18:14:36.312961 25275 consensus_queue.cc:237] T c261a6be40f14abcb58a05c73a693342 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.312917 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.013s user 0.005s sys 0.004s Metrics: {"bytes_written":5157,"cfile_init":1,"dirs.queue_time_us":63,"dirs.run_cpu_time_us":203,"dirs.run_wall_time_us":1120,"drs_written":1,"lbm_read_time_us":86,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1337,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:36.313944 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.220861
I20260807 18:14:36.319670 24957 catalog_manager.cc:5495] T c261a6be40f14abcb58a05c73a693342 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:36.347235 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.031s user 0.026s sys 0.004s Metrics: {"bytes_written":336,"cfile_cache_hit":12,"cfile_cache_hit_bytes":38026,"cfile_cache_miss":28,"cfile_cache_miss_bytes":56034,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":1172,"dirs.run_cpu_time_us":846,"dirs.run_wall_time_us":4539,"drs_written":1,"lbm_read_time_us":1252,"lbm_reads_lt_1ms":60,"lbm_write_time_us":1558,"lbm_writes_lt_1ms":32,"mutex_wait_us":27,"num_input_rowsets":2,"peak_mem_usage":28398,"reinsert_count":0,"rows_written":201,"spinlock_wait_cycles":3200,"update_count":1}
I20260807 18:14:36.348284 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8703 bytes on disk
I20260807 18:14:36.348871 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":90,"lbm_reads_lt_1ms":4}
I20260807 18:14:36.357118 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49890:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.100"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:36.369305 25147 tablet_service.cc:1467] Processing CreateTablet for tablet e058ceab46fa4c729aa95bb10761f924 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.100 [id=7d246d0f2f6d4df79c8fe2b7e96da759]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:36.369905 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e058ceab46fa4c729aa95bb10761f924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:36.375150 25269 tablet_bootstrap.cc:492] T e058ceab46fa4c729aa95bb10761f924 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:36.376973 25269 tablet_bootstrap.cc:654] T e058ceab46fa4c729aa95bb10761f924 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:36.379618 25269 tablet_bootstrap.cc:492] T e058ceab46fa4c729aa95bb10761f924 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:36.379788 25269 ts_tablet_manager.cc:1397] T e058ceab46fa4c729aa95bb10761f924 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 18:14:36.380412 25269 raft_consensus.cc:348] T e058ceab46fa4c729aa95bb10761f924 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.380600 25269 raft_consensus.cc:374] T e058ceab46fa4c729aa95bb10761f924 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:36.380757 25269 raft_consensus.cc:729] T e058ceab46fa4c729aa95bb10761f924 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:36.381096 25269 consensus_queue.cc:260] T e058ceab46fa4c729aa95bb10761f924 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.381392 25269 raft_consensus.cc:388] T e058ceab46fa4c729aa95bb10761f924 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:36.381536 25269 raft_consensus.cc:482] T e058ceab46fa4c729aa95bb10761f924 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:36.381690 25269 raft_consensus.cc:3037] T e058ceab46fa4c729aa95bb10761f924 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:36.384025 25269 raft_consensus.cc:504] T e058ceab46fa4c729aa95bb10761f924 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.384351 25269 leader_election.cc:302] T e058ceab46fa4c729aa95bb10761f924 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:36.384603 25269 leader_election.cc:288] T e058ceab46fa4c729aa95bb10761f924 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:36.384723 25275 raft_consensus.cc:2781] T e058ceab46fa4c729aa95bb10761f924 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:36.384919 25275 raft_consensus.cc:686] T e058ceab46fa4c729aa95bb10761f924 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:36.385169 25275 consensus_queue.cc:237] T e058ceab46fa4c729aa95bb10761f924 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.385610 25269 ts_tablet_manager.cc:1428] T e058ceab46fa4c729aa95bb10761f924 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260807 18:14:36.393232 24957 catalog_manager.cc:5495] T e058ceab46fa4c729aa95bb10761f924 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:36.424491 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49894:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.101"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:36.436611 25147 tablet_service.cc:1467] Processing CreateTablet for tablet d3c5dc3597a845c5a9d7e757ae7eb567 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.101 [id=d0ad510d018041719c16c664fe8179db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:36.437328 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3c5dc3597a845c5a9d7e757ae7eb567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:36.444214 25269 tablet_bootstrap.cc:492] T d3c5dc3597a845c5a9d7e757ae7eb567 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:36.446216 25269 tablet_bootstrap.cc:654] T d3c5dc3597a845c5a9d7e757ae7eb567 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:36.448005 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000081
I20260807 18:14:36.449753 25269 tablet_bootstrap.cc:492] T d3c5dc3597a845c5a9d7e757ae7eb567 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:36.449935 25269 ts_tablet_manager.cc:1397] T d3c5dc3597a845c5a9d7e757ae7eb567 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260807 18:14:36.450677 25269 raft_consensus.cc:348] T d3c5dc3597a845c5a9d7e757ae7eb567 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.450889 25269 raft_consensus.cc:374] T d3c5dc3597a845c5a9d7e757ae7eb567 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:36.450982 25269 raft_consensus.cc:729] T d3c5dc3597a845c5a9d7e757ae7eb567 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:36.451257 25269 consensus_queue.cc:260] T d3c5dc3597a845c5a9d7e757ae7eb567 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.451428 25269 raft_consensus.cc:388] T d3c5dc3597a845c5a9d7e757ae7eb567 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:36.451543 25269 raft_consensus.cc:482] T d3c5dc3597a845c5a9d7e757ae7eb567 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:36.451653 25269 raft_consensus.cc:3037] T d3c5dc3597a845c5a9d7e757ae7eb567 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:36.454298 25269 raft_consensus.cc:504] T d3c5dc3597a845c5a9d7e757ae7eb567 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.454566 25269 leader_election.cc:302] T d3c5dc3597a845c5a9d7e757ae7eb567 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:36.454898 25269 leader_election.cc:288] T d3c5dc3597a845c5a9d7e757ae7eb567 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:36.454962 25275 raft_consensus.cc:2781] T d3c5dc3597a845c5a9d7e757ae7eb567 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:36.455214 25275 raft_consensus.cc:686] T d3c5dc3597a845c5a9d7e757ae7eb567 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:36.455508 25275 consensus_queue.cc:237] T d3c5dc3597a845c5a9d7e757ae7eb567 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.455999 25269 ts_tablet_manager.cc:1428] T d3c5dc3597a845c5a9d7e757ae7eb567 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260807 18:14:36.460731 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.007s sys 0.003s Metrics: {"bytes_written":6461,"cfile_init":1,"dirs.queue_time_us":60,"dirs.run_cpu_time_us":170,"dirs.run_wall_time_us":1333,"drs_written":1,"lbm_read_time_us":89,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1004,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":8}
I20260807 18:14:36.461674 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.244305
I20260807 18:14:36.464704 24956 catalog_manager.cc:5495] T d3c5dc3597a845c5a9d7e757ae7eb567 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:36.495223 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.033s user 0.030s sys 0.001s Metrics: {"bytes_written":336,"cfile_cache_hit":12,"cfile_cache_hit_bytes":38760,"cfile_cache_miss":28,"cfile_cache_miss_bytes":57298,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":679,"dirs.run_cpu_time_us":254,"dirs.run_wall_time_us":1425,"drs_written":1,"lbm_read_time_us":1282,"lbm_reads_lt_1ms":60,"lbm_write_time_us":1361,"lbm_writes_lt_1ms":32,"mutex_wait_us":108,"num_input_rowsets":2,"peak_mem_usage":28905,"reinsert_count":0,"rows_written":205,"update_count":1}
I20260807 18:14:36.496034 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8875 bytes on disk
I20260807 18:14:36.496848 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":87,"lbm_reads_lt_1ms":4}
I20260807 18:14:36.506371 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49908:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.102"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:36.520094 25147 tablet_service.cc:1467] Processing CreateTablet for tablet a6e5dad0ed2f43b1b26b8bf4333b273a (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.102 [id=37f3e31e7d804a9d887eda6b2384cd8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:36.520699 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6e5dad0ed2f43b1b26b8bf4333b273a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:36.528383 25269 tablet_bootstrap.cc:492] T a6e5dad0ed2f43b1b26b8bf4333b273a P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:36.530790 25269 tablet_bootstrap.cc:654] T a6e5dad0ed2f43b1b26b8bf4333b273a P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:36.537168 25269 tablet_bootstrap.cc:492] T a6e5dad0ed2f43b1b26b8bf4333b273a P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:36.537493 25269 ts_tablet_manager.cc:1397] T a6e5dad0ed2f43b1b26b8bf4333b273a P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260807 18:14:36.539058 25269 raft_consensus.cc:348] T a6e5dad0ed2f43b1b26b8bf4333b273a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.539413 25269 raft_consensus.cc:374] T a6e5dad0ed2f43b1b26b8bf4333b273a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:36.539613 25269 raft_consensus.cc:729] T a6e5dad0ed2f43b1b26b8bf4333b273a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:36.540002 25269 consensus_queue.cc:260] T a6e5dad0ed2f43b1b26b8bf4333b273a P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.540427 25269 raft_consensus.cc:388] T a6e5dad0ed2f43b1b26b8bf4333b273a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:36.540647 25269 raft_consensus.cc:482] T a6e5dad0ed2f43b1b26b8bf4333b273a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:36.540886 25269 raft_consensus.cc:3037] T a6e5dad0ed2f43b1b26b8bf4333b273a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:36.545111 25269 raft_consensus.cc:504] T a6e5dad0ed2f43b1b26b8bf4333b273a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.545575 25269 leader_election.cc:302] T a6e5dad0ed2f43b1b26b8bf4333b273a P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:36.545871 25269 leader_election.cc:288] T a6e5dad0ed2f43b1b26b8bf4333b273a P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:36.546355 25277 raft_consensus.cc:2781] T a6e5dad0ed2f43b1b26b8bf4333b273a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:36.546764 25269 ts_tablet_manager.cc:1428] T a6e5dad0ed2f43b1b26b8bf4333b273a P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260807 18:14:36.546810 25277 raft_consensus.cc:686] T a6e5dad0ed2f43b1b26b8bf4333b273a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:36.547627 25277 consensus_queue.cc:237] T a6e5dad0ed2f43b1b26b8bf4333b273a P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.560822 24956 catalog_manager.cc:5495] T a6e5dad0ed2f43b1b26b8bf4333b273a P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:36.599920 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000080
I20260807 18:14:36.610601 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.010s user 0.009s sys 0.000s Metrics: {"bytes_written":6069,"cfile_init":1,"dirs.queue_time_us":53,"dirs.run_cpu_time_us":235,"dirs.run_wall_time_us":1440,"drs_written":1,"lbm_read_time_us":61,"lbm_reads_lt_1ms":4,"lbm_write_time_us":862,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:36.611671 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 517 bytes on disk
I20260807 18:14:36.612270 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":94,"lbm_reads_lt_1ms":4}
I20260807 18:14:36.613621 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.237825
I20260807 18:14:36.622611 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49922:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.103"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:36.637805 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 332d47e8171a404799e4eb1558f7a89b (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.103 [id=fbf3278e74fb45dcbab20ee3c64e7bb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:36.638384 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 332d47e8171a404799e4eb1558f7a89b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:36.644765 25269 tablet_bootstrap.cc:492] T 332d47e8171a404799e4eb1558f7a89b P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:36.646512 25269 tablet_bootstrap.cc:654] T 332d47e8171a404799e4eb1558f7a89b P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:36.653012 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.039s user 0.028s sys 0.007s Metrics: {"bytes_written":50686,"cfile_cache_hit":13,"cfile_cache_hit_bytes":39171,"cfile_cache_miss":31,"cfile_cache_miss_bytes":58281,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":659,"dirs.run_cpu_time_us":202,"dirs.run_wall_time_us":2596,"drs_written":1,"lbm_read_time_us":1738,"lbm_reads_lt_1ms":63,"lbm_write_time_us":1893,"lbm_writes_lt_1ms":28,"mutex_wait_us":183,"num_input_rowsets":2,"peak_mem_usage":29384,"rows_written":207}
I20260807 18:14:36.654028 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8976 bytes on disk
I20260807 18:14:36.654714 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":91,"lbm_reads_lt_1ms":4}
I20260807 18:14:36.655229 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000012
I20260807 18:14:36.656576 25269 tablet_bootstrap.cc:492] T 332d47e8171a404799e4eb1558f7a89b P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:36.656817 25269 ts_tablet_manager.cc:1397] T 332d47e8171a404799e4eb1558f7a89b P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.003s
I20260807 18:14:36.658164 25269 raft_consensus.cc:348] T 332d47e8171a404799e4eb1558f7a89b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.658496 25269 raft_consensus.cc:374] T 332d47e8171a404799e4eb1558f7a89b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:36.658617 25269 raft_consensus.cc:729] T 332d47e8171a404799e4eb1558f7a89b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:36.659029 25269 consensus_queue.cc:260] T 332d47e8171a404799e4eb1558f7a89b P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.659325 25269 raft_consensus.cc:388] T 332d47e8171a404799e4eb1558f7a89b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:36.659488 25269 raft_consensus.cc:482] T 332d47e8171a404799e4eb1558f7a89b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:36.659655 25269 raft_consensus.cc:3037] T 332d47e8171a404799e4eb1558f7a89b P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:36.662714 25269 raft_consensus.cc:504] T 332d47e8171a404799e4eb1558f7a89b P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.663023 25269 leader_election.cc:302] T 332d47e8171a404799e4eb1558f7a89b P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:36.663314 25269 leader_election.cc:288] T 332d47e8171a404799e4eb1558f7a89b P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:36.663359 25277 raft_consensus.cc:2781] T 332d47e8171a404799e4eb1558f7a89b P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:36.663543 25277 raft_consensus.cc:686] T 332d47e8171a404799e4eb1558f7a89b P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:36.663816 25277 consensus_queue.cc:237] T 332d47e8171a404799e4eb1558f7a89b P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.664505 25269 ts_tablet_manager.cc:1428] T 332d47e8171a404799e4eb1558f7a89b P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260807 18:14:36.666982 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.007s sys 0.003s Metrics: {"bytes_written":5158,"cfile_init":1,"dirs.queue_time_us":115,"dirs.run_cpu_time_us":153,"dirs.run_wall_time_us":1292,"drs_written":1,"lbm_read_time_us":86,"lbm_reads_lt_1ms":4,"lbm_write_time_us":832,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:36.667927 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 235 bytes on disk
I20260807 18:14:36.668704 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":108,"lbm_reads_lt_1ms":4}
I20260807 18:14:36.669883 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.159690
I20260807 18:14:36.671423 24956 catalog_manager.cc:5495] T 332d47e8171a404799e4eb1558f7a89b P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:36.708123 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.038s user 0.035s sys 0.000s Metrics: {"bytes_written":336,"cfile_cache_hit":12,"cfile_cache_hit_bytes":39506,"cfile_cache_miss":28,"cfile_cache_miss_bytes":58196,"cfile_init":7,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":809,"dirs.run_cpu_time_us":241,"dirs.run_wall_time_us":1158,"drs_written":1,"lbm_read_time_us":1313,"lbm_reads_lt_1ms":56,"lbm_write_time_us":1712,"lbm_writes_lt_1ms":32,"mutex_wait_us":106,"num_input_rowsets":2,"peak_mem_usage":29418,"reinsert_count":0,"rows_written":209,"update_count":1}
I20260807 18:14:36.709249 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9040 bytes on disk
I20260807 18:14:36.710322 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":124,"lbm_reads_lt_1ms":4}
I20260807 18:14:36.725597 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49926:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.104"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:36.741065 25147 tablet_service.cc:1467] Processing CreateTablet for tablet df5d170736d241d38eca57a0d655b73a (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.104 [id=84109ae0a32e4959ae2be2e684e79268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:36.741667 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df5d170736d241d38eca57a0d655b73a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:36.747906 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000080
I20260807 18:14:36.749331 25269 tablet_bootstrap.cc:492] T df5d170736d241d38eca57a0d655b73a P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:36.751451 25269 tablet_bootstrap.cc:654] T df5d170736d241d38eca57a0d655b73a P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:36.755481 25269 tablet_bootstrap.cc:492] T df5d170736d241d38eca57a0d655b73a P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:36.755668 25269 ts_tablet_manager.cc:1397] T df5d170736d241d38eca57a0d655b73a P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260807 18:14:36.756686 25269 raft_consensus.cc:348] T df5d170736d241d38eca57a0d655b73a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.756981 25269 raft_consensus.cc:374] T df5d170736d241d38eca57a0d655b73a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:36.757210 25269 raft_consensus.cc:729] T df5d170736d241d38eca57a0d655b73a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:36.757532 25269 consensus_queue.cc:260] T df5d170736d241d38eca57a0d655b73a P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.757771 25269 raft_consensus.cc:388] T df5d170736d241d38eca57a0d655b73a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:36.757947 25269 raft_consensus.cc:482] T df5d170736d241d38eca57a0d655b73a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:36.758149 25269 raft_consensus.cc:3037] T df5d170736d241d38eca57a0d655b73a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:36.759663 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.011s user 0.005s sys 0.004s Metrics: {"bytes_written":6032,"cfile_init":1,"dirs.queue_time_us":63,"dirs.run_cpu_time_us":236,"dirs.run_wall_time_us":1395,"drs_written":1,"lbm_read_time_us":49,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1148,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:36.760389 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 506 bytes on disk
I20260807 18:14:36.760650 25269 raft_consensus.cc:504] T df5d170736d241d38eca57a0d655b73a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.760933 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":67,"lbm_reads_lt_1ms":4}
I20260807 18:14:36.761092 25269 leader_election.cc:302] T df5d170736d241d38eca57a0d655b73a P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:36.761483 25277 raft_consensus.cc:2781] T df5d170736d241d38eca57a0d655b73a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:36.761720 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.236098
I20260807 18:14:36.761699 25277 raft_consensus.cc:686] T df5d170736d241d38eca57a0d655b73a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:36.761801 25269 leader_election.cc:288] T df5d170736d241d38eca57a0d655b73a P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:36.762068 25277 consensus_queue.cc:237] T df5d170736d241d38eca57a0d655b73a P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.763159 25269 ts_tablet_manager.cc:1428] T df5d170736d241d38eca57a0d655b73a P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260807 18:14:36.769582 24956 catalog_manager.cc:5495] T df5d170736d241d38eca57a0d655b73a P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:36.794071 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.032s user 0.028s sys 0.000s Metrics: {"bytes_written":389,"cfile_cache_hit":13,"cfile_cache_hit_bytes":39874,"cfile_cache_miss":31,"cfile_cache_miss_bytes":59302,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":6,"dirs.queue_time_us":512,"dirs.run_cpu_time_us":206,"dirs.run_wall_time_us":1327,"drs_written":1,"lbm_read_time_us":1273,"lbm_reads_lt_1ms":63,"lbm_write_time_us":1060,"lbm_writes_lt_1ms":32,"mutex_wait_us":68,"num_input_rowsets":2,"peak_mem_usage":29724,"reinsert_count":0,"rows_written":211,"spinlock_wait_cycles":6912,"update_count":2}
I20260807 18:14:36.795115 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9120 bytes on disk
I20260807 18:14:36.795680 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":62,"lbm_reads_lt_1ms":4}
I20260807 18:14:36.823443 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49930:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.105"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:36.835826 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 86bfb1a32ce54e528b6f96a2a56ea822 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.105 [id=3a34f95222234b73a42074ea7e304cac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:36.836369 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86bfb1a32ce54e528b6f96a2a56ea822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:36.841440 25269 tablet_bootstrap.cc:492] T 86bfb1a32ce54e528b6f96a2a56ea822 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:36.843235 25269 tablet_bootstrap.cc:654] T 86bfb1a32ce54e528b6f96a2a56ea822 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:36.846136 25269 tablet_bootstrap.cc:492] T 86bfb1a32ce54e528b6f96a2a56ea822 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:36.846432 25269 ts_tablet_manager.cc:1397] T 86bfb1a32ce54e528b6f96a2a56ea822 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260807 18:14:36.847249 25269 raft_consensus.cc:348] T 86bfb1a32ce54e528b6f96a2a56ea822 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.847568 25269 raft_consensus.cc:374] T 86bfb1a32ce54e528b6f96a2a56ea822 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:36.847731 25269 raft_consensus.cc:729] T 86bfb1a32ce54e528b6f96a2a56ea822 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:36.848127 25269 consensus_queue.cc:260] T 86bfb1a32ce54e528b6f96a2a56ea822 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.848398 25269 raft_consensus.cc:388] T 86bfb1a32ce54e528b6f96a2a56ea822 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:36.848604 25269 raft_consensus.cc:482] T 86bfb1a32ce54e528b6f96a2a56ea822 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:36.848778 25269 raft_consensus.cc:3037] T 86bfb1a32ce54e528b6f96a2a56ea822 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:36.850732 25269 raft_consensus.cc:504] T 86bfb1a32ce54e528b6f96a2a56ea822 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.850991 25269 leader_election.cc:302] T 86bfb1a32ce54e528b6f96a2a56ea822 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:36.851229 25269 leader_election.cc:288] T 86bfb1a32ce54e528b6f96a2a56ea822 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:36.851336 25277 raft_consensus.cc:2781] T 86bfb1a32ce54e528b6f96a2a56ea822 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:36.851581 25277 raft_consensus.cc:686] T 86bfb1a32ce54e528b6f96a2a56ea822 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:36.851727 25269 ts_tablet_manager.cc:1428] T 86bfb1a32ce54e528b6f96a2a56ea822 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.003s sys 0.001s
I20260807 18:14:36.851902 25277 consensus_queue.cc:237] T 86bfb1a32ce54e528b6f96a2a56ea822 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.859699 24956 catalog_manager.cc:5495] T 86bfb1a32ce54e528b6f96a2a56ea822 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:36.893306 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49940:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.106"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:36.905510 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 9196d493951b45fbbb70bcec9a7e6f63 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.106 [id=507ac89acb9348459b5ea6d7c68f8849]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:36.906005 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9196d493951b45fbbb70bcec9a7e6f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:36.912180 25269 tablet_bootstrap.cc:492] T 9196d493951b45fbbb70bcec9a7e6f63 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:36.914371 25269 tablet_bootstrap.cc:654] T 9196d493951b45fbbb70bcec9a7e6f63 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:36.917768 25269 tablet_bootstrap.cc:492] T 9196d493951b45fbbb70bcec9a7e6f63 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:36.917946 25269 ts_tablet_manager.cc:1397] T 9196d493951b45fbbb70bcec9a7e6f63 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260807 18:14:36.918995 25269 raft_consensus.cc:348] T 9196d493951b45fbbb70bcec9a7e6f63 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.919231 25269 raft_consensus.cc:374] T 9196d493951b45fbbb70bcec9a7e6f63 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:36.919462 25269 raft_consensus.cc:729] T 9196d493951b45fbbb70bcec9a7e6f63 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:36.919775 25269 consensus_queue.cc:260] T 9196d493951b45fbbb70bcec9a7e6f63 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.920064 25269 raft_consensus.cc:388] T 9196d493951b45fbbb70bcec9a7e6f63 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:36.920220 25269 raft_consensus.cc:482] T 9196d493951b45fbbb70bcec9a7e6f63 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:36.920414 25269 raft_consensus.cc:3037] T 9196d493951b45fbbb70bcec9a7e6f63 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:36.923202 25269 raft_consensus.cc:504] T 9196d493951b45fbbb70bcec9a7e6f63 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.923524 25269 leader_election.cc:302] T 9196d493951b45fbbb70bcec9a7e6f63 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:36.923784 25269 leader_election.cc:288] T 9196d493951b45fbbb70bcec9a7e6f63 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:36.923933 25277 raft_consensus.cc:2781] T 9196d493951b45fbbb70bcec9a7e6f63 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:36.924336 25277 raft_consensus.cc:686] T 9196d493951b45fbbb70bcec9a7e6f63 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:36.924424 25269 ts_tablet_manager.cc:1428] T 9196d493951b45fbbb70bcec9a7e6f63 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260807 18:14:36.924696 25277 consensus_queue.cc:237] T 9196d493951b45fbbb70bcec9a7e6f63 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:36.931006 24956 catalog_manager.cc:5495] T 9196d493951b45fbbb70bcec9a7e6f63 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:36.961638 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000082
I20260807 18:14:36.977028 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.015s user 0.011s sys 0.001s Metrics: {"bytes_written":6069,"cfile_init":1,"dirs.queue_time_us":73,"dirs.run_cpu_time_us":263,"dirs.run_wall_time_us":1445,"drs_written":1,"lbm_read_time_us":74,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1218,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:36.978681 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.236177
I20260807 18:14:37.000629 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49954:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.107"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:37.017465 25147 tablet_service.cc:1467] Processing CreateTablet for tablet ec6648859903497f94ddc9f712c8bd57 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.107 [id=5da849bd124a4039bf17f866c7408cfc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:37.018525 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec6648859903497f94ddc9f712c8bd57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:37.020316 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.041s user 0.033s sys 0.005s Metrics: {"bytes_written":52428,"cfile_cache_hit":13,"cfile_cache_hit_bytes":40651,"cfile_cache_miss":31,"cfile_cache_miss_bytes":60503,"cfile_init":9,"delta_iterators_relevant":6,"dirs.queue_time_us":542,"dirs.run_cpu_time_us":191,"dirs.run_wall_time_us":1077,"drs_written":1,"lbm_read_time_us":1315,"lbm_reads_lt_1ms":67,"lbm_write_time_us":2352,"lbm_writes_lt_1ms":28,"mutex_wait_us":47,"num_input_rowsets":2,"peak_mem_usage":30613,"rows_written":215,"spinlock_wait_cycles":7424}
I20260807 18:14:37.021615 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9320 bytes on disk
I20260807 18:14:37.022260 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":96,"lbm_reads_lt_1ms":4}
I20260807 18:14:37.022909 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000013
I20260807 18:14:37.027139 25269 tablet_bootstrap.cc:492] T ec6648859903497f94ddc9f712c8bd57 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:37.032024 25269 tablet_bootstrap.cc:654] T ec6648859903497f94ddc9f712c8bd57 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:37.039721 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.015s user 0.011s sys 0.000s Metrics: {"bytes_written":5158,"cfile_init":1,"dirs.queue_time_us":73,"dirs.run_cpu_time_us":177,"dirs.run_wall_time_us":974,"drs_written":1,"lbm_read_time_us":112,"lbm_reads_lt_1ms":4,"lbm_write_time_us":818,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:37.040014 25269 tablet_bootstrap.cc:492] T ec6648859903497f94ddc9f712c8bd57 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:37.040220 25269 ts_tablet_manager.cc:1397] T ec6648859903497f94ddc9f712c8bd57 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.003s
I20260807 18:14:37.040685 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.220534
I20260807 18:14:37.041289 25269 raft_consensus.cc:348] T ec6648859903497f94ddc9f712c8bd57 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.041711 25269 raft_consensus.cc:374] T ec6648859903497f94ddc9f712c8bd57 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:37.041844 25269 raft_consensus.cc:729] T ec6648859903497f94ddc9f712c8bd57 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:37.042299 25269 consensus_queue.cc:260] T ec6648859903497f94ddc9f712c8bd57 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.042549 25269 raft_consensus.cc:388] T ec6648859903497f94ddc9f712c8bd57 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:37.042800 25269 raft_consensus.cc:482] T ec6648859903497f94ddc9f712c8bd57 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:37.042981 25269 raft_consensus.cc:3037] T ec6648859903497f94ddc9f712c8bd57 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:37.046854 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000080
I20260807 18:14:37.047533 25269 raft_consensus.cc:504] T ec6648859903497f94ddc9f712c8bd57 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.048053 25269 leader_election.cc:302] T ec6648859903497f94ddc9f712c8bd57 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:37.048550 25277 raft_consensus.cc:2781] T ec6648859903497f94ddc9f712c8bd57 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:37.048822 25277 raft_consensus.cc:686] T ec6648859903497f94ddc9f712c8bd57 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:37.049276 25277 consensus_queue.cc:237] T ec6648859903497f94ddc9f712c8bd57 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.055128 25269 leader_election.cc:288] T ec6648859903497f94ddc9f712c8bd57 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:37.056074 25269 ts_tablet_manager.cc:1428] T ec6648859903497f94ddc9f712c8bd57 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.016s user 0.005s sys 0.005s
I20260807 18:14:37.066236 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.019s user 0.008s sys 0.008s Metrics: {"bytes_written":6031,"cfile_init":1,"dirs.queue_time_us":42,"dirs.run_cpu_time_us":164,"dirs.run_wall_time_us":1211,"drs_written":1,"lbm_read_time_us":111,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1365,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:37.067220 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.235806
I20260807 18:14:37.070986 24956 catalog_manager.cc:5495] T ec6648859903497f94ddc9f712c8bd57 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:37.091477 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.050s user 0.026s sys 0.018s Metrics: {"bytes_written":333,"cfile_cache_hit":12,"cfile_cache_hit_bytes":40986,"cfile_cache_miss":28,"cfile_cache_miss_bytes":60368,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":1141,"dirs.run_cpu_time_us":191,"dirs.run_wall_time_us":1253,"drs_written":1,"lbm_read_time_us":1278,"lbm_reads_lt_1ms":60,"lbm_write_time_us":1736,"lbm_writes_lt_1ms":32,"num_input_rowsets":2,"peak_mem_usage":30642,"reinsert_count":0,"rows_written":217,"spinlock_wait_cycles":17408,"update_count":1}
I20260807 18:14:37.092557 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9392 bytes on disk
I20260807 18:14:37.093214 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":122,"lbm_reads_lt_1ms":4}
I20260807 18:14:37.118726 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.051s user 0.039s sys 0.004s Metrics: {"bytes_written":389,"cfile_cache_hit":13,"cfile_cache_hit_bytes":40979,"cfile_cache_miss":31,"cfile_cache_miss_bytes":60999,"cfile_init":9,"delete_count":0,"delta_iterators_relevant":6,"dirs.queue_time_us":587,"dirs.run_cpu_time_us":197,"dirs.run_wall_time_us":1449,"drs_written":1,"lbm_read_time_us":1777,"lbm_reads_lt_1ms":67,"lbm_write_time_us":1705,"lbm_writes_lt_1ms":32,"mutex_wait_us":122,"num_input_rowsets":2,"peak_mem_usage":30692,"reinsert_count":0,"rows_written":217,"update_count":2}
I20260807 18:14:37.119695 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9392 bytes on disk
I20260807 18:14:37.120193 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":61,"lbm_reads_lt_1ms":4}
I20260807 18:14:37.135545 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49962:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.108"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:37.148468 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 7683e7c679e648c6971bfef494408e0a (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.108 [id=36951aecbaba43859229dc9be409850c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:37.149080 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7683e7c679e648c6971bfef494408e0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:37.154984 25269 tablet_bootstrap.cc:492] T 7683e7c679e648c6971bfef494408e0a P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:37.156646 25269 tablet_bootstrap.cc:654] T 7683e7c679e648c6971bfef494408e0a P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:37.159137 25269 tablet_bootstrap.cc:492] T 7683e7c679e648c6971bfef494408e0a P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:37.159288 25269 ts_tablet_manager.cc:1397] T 7683e7c679e648c6971bfef494408e0a P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260807 18:14:37.159945 25269 raft_consensus.cc:348] T 7683e7c679e648c6971bfef494408e0a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.160121 25269 raft_consensus.cc:374] T 7683e7c679e648c6971bfef494408e0a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:37.160228 25269 raft_consensus.cc:729] T 7683e7c679e648c6971bfef494408e0a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:37.160491 25269 consensus_queue.cc:260] T 7683e7c679e648c6971bfef494408e0a P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.160692 25269 raft_consensus.cc:388] T 7683e7c679e648c6971bfef494408e0a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:37.160799 25269 raft_consensus.cc:482] T 7683e7c679e648c6971bfef494408e0a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:37.160926 25269 raft_consensus.cc:3037] T 7683e7c679e648c6971bfef494408e0a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:37.162899 25269 raft_consensus.cc:504] T 7683e7c679e648c6971bfef494408e0a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.163159 25269 leader_election.cc:302] T 7683e7c679e648c6971bfef494408e0a P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:37.163345 25269 leader_election.cc:288] T 7683e7c679e648c6971bfef494408e0a P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:37.163434 25276 raft_consensus.cc:2781] T 7683e7c679e648c6971bfef494408e0a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:37.163632 25276 raft_consensus.cc:686] T 7683e7c679e648c6971bfef494408e0a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:37.164098 25269 ts_tablet_manager.cc:1428] T 7683e7c679e648c6971bfef494408e0a P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260807 18:14:37.164094 25276 consensus_queue.cc:237] T 7683e7c679e648c6971bfef494408e0a P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.170744 24956 catalog_manager.cc:5495] T 7683e7c679e648c6971bfef494408e0a P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:37.213307 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49974:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.109"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:37.224790 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 8145f52db32f43ad9980c1a2daf493d4 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.109 [id=04c38727ca2a43eebdf6673644d44fd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:37.225188 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8145f52db32f43ad9980c1a2daf493d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:37.230566 25269 tablet_bootstrap.cc:492] T 8145f52db32f43ad9980c1a2daf493d4 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:37.231945 25269 tablet_bootstrap.cc:654] T 8145f52db32f43ad9980c1a2daf493d4 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:37.234463 25269 tablet_bootstrap.cc:492] T 8145f52db32f43ad9980c1a2daf493d4 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:37.234627 25269 ts_tablet_manager.cc:1397] T 8145f52db32f43ad9980c1a2daf493d4 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260807 18:14:37.235297 25269 raft_consensus.cc:348] T 8145f52db32f43ad9980c1a2daf493d4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.235495 25269 raft_consensus.cc:374] T 8145f52db32f43ad9980c1a2daf493d4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:37.235612 25269 raft_consensus.cc:729] T 8145f52db32f43ad9980c1a2daf493d4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:37.236037 25269 consensus_queue.cc:260] T 8145f52db32f43ad9980c1a2daf493d4 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.236251 25269 raft_consensus.cc:388] T 8145f52db32f43ad9980c1a2daf493d4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:37.236426 25269 raft_consensus.cc:482] T 8145f52db32f43ad9980c1a2daf493d4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:37.236557 25269 raft_consensus.cc:3037] T 8145f52db32f43ad9980c1a2daf493d4 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:37.239168 25269 raft_consensus.cc:504] T 8145f52db32f43ad9980c1a2daf493d4 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.239382 25269 leader_election.cc:302] T 8145f52db32f43ad9980c1a2daf493d4 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:37.239681 25269 leader_election.cc:288] T 8145f52db32f43ad9980c1a2daf493d4 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:37.239687 25276 raft_consensus.cc:2781] T 8145f52db32f43ad9980c1a2daf493d4 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:37.239959 25276 raft_consensus.cc:686] T 8145f52db32f43ad9980c1a2daf493d4 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:37.240258 25276 consensus_queue.cc:237] T 8145f52db32f43ad9980c1a2daf493d4 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.240679 25269 ts_tablet_manager.cc:1428] T 8145f52db32f43ad9980c1a2daf493d4 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260807 18:14:37.247859 24956 catalog_manager.cc:5495] T 8145f52db32f43ad9980c1a2daf493d4 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:37.284502 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49988:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.110"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:37.296693 25147 tablet_service.cc:1467] Processing CreateTablet for tablet d23eff046d5f4ed39a069a22d7ca63df (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.110 [id=bac0cc5584454caabb41a932ff1420d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:37.297302 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d23eff046d5f4ed39a069a22d7ca63df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:37.303840 25269 tablet_bootstrap.cc:492] T d23eff046d5f4ed39a069a22d7ca63df P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:37.306093 25269 tablet_bootstrap.cc:654] T d23eff046d5f4ed39a069a22d7ca63df P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:37.310066 25269 tablet_bootstrap.cc:492] T d23eff046d5f4ed39a069a22d7ca63df P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:37.310273 25269 ts_tablet_manager.cc:1397] T d23eff046d5f4ed39a069a22d7ca63df P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260807 18:14:37.311265 25269 raft_consensus.cc:348] T d23eff046d5f4ed39a069a22d7ca63df P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.311611 25269 raft_consensus.cc:374] T d23eff046d5f4ed39a069a22d7ca63df P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:37.311754 25269 raft_consensus.cc:729] T d23eff046d5f4ed39a069a22d7ca63df P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:37.312091 25269 consensus_queue.cc:260] T d23eff046d5f4ed39a069a22d7ca63df P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.312435 25269 raft_consensus.cc:388] T d23eff046d5f4ed39a069a22d7ca63df P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:37.312618 25269 raft_consensus.cc:482] T d23eff046d5f4ed39a069a22d7ca63df P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:37.312846 25269 raft_consensus.cc:3037] T d23eff046d5f4ed39a069a22d7ca63df P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:37.315996 25269 raft_consensus.cc:504] T d23eff046d5f4ed39a069a22d7ca63df P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.316330 25269 leader_election.cc:302] T d23eff046d5f4ed39a069a22d7ca63df P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:37.316557 25269 leader_election.cc:288] T d23eff046d5f4ed39a069a22d7ca63df P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:37.316820 25276 raft_consensus.cc:2781] T d23eff046d5f4ed39a069a22d7ca63df P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:37.317066 25276 raft_consensus.cc:686] T d23eff046d5f4ed39a069a22d7ca63df P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:37.317148 25269 ts_tablet_manager.cc:1428] T d23eff046d5f4ed39a069a22d7ca63df P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260807 18:14:37.317507 25276 consensus_queue.cc:237] T d23eff046d5f4ed39a069a22d7ca63df P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.324326 24956 catalog_manager.cc:5495] T d23eff046d5f4ed39a069a22d7ca63df P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:37.344239 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000085
I20260807 18:14:37.356283 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.005s sys 0.003s Metrics: {"bytes_written":6069,"cfile_init":1,"dirs.queue_time_us":72,"dirs.run_cpu_time_us":205,"dirs.run_wall_time_us":1392,"drs_written":1,"lbm_read_time_us":83,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1048,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:37.357287 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.236992
I20260807 18:14:37.371088 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000085
I20260807 18:14:37.375010 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50004:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.111"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:37.385142 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.014s user 0.009s sys 0.000s Metrics: {"bytes_written":6069,"cfile_init":1,"dirs.queue_time_us":66,"dirs.run_cpu_time_us":209,"dirs.run_wall_time_us":2369,"drs_written":1,"lbm_read_time_us":89,"lbm_reads_lt_1ms":4,"lbm_write_time_us":970,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:37.386205 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 518 bytes on disk
I20260807 18:14:37.386886 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":96,"lbm_reads_lt_1ms":4}
I20260807 18:14:37.388649 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.236955
I20260807 18:14:37.389037 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 392abf827ffa42c98fc9e816c5cd5152 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.111 [id=34c09b453f47452ca7769be6db8ed3bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:37.389631 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 392abf827ffa42c98fc9e816c5cd5152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:37.395912 25269 tablet_bootstrap.cc:492] T 392abf827ffa42c98fc9e816c5cd5152 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:37.396847 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.039s user 0.030s sys 0.004s Metrics: {"bytes_written":54167,"cfile_cache_hit":13,"cfile_cache_hit_bytes":42131,"cfile_cache_miss":31,"cfile_cache_miss_bytes":62607,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":439,"dirs.run_cpu_time_us":163,"dirs.run_wall_time_us":2532,"drs_written":1,"lbm_read_time_us":1338,"lbm_reads_lt_1ms":63,"lbm_write_time_us":1729,"lbm_writes_lt_1ms":28,"mutex_wait_us":33,"num_input_rowsets":2,"peak_mem_usage":31405,"rows_written":223,"spinlock_wait_cycles":1920}
I20260807 18:14:37.398263 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9665 bytes on disk
I20260807 18:14:37.398777 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":67,"lbm_reads_lt_1ms":4}
I20260807 18:14:37.398984 25269 tablet_bootstrap.cc:654] T 392abf827ffa42c98fc9e816c5cd5152 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:37.399319 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000012
I20260807 18:14:37.407408 25269 tablet_bootstrap.cc:492] T 392abf827ffa42c98fc9e816c5cd5152 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:37.407632 25269 ts_tablet_manager.cc:1397] T 392abf827ffa42c98fc9e816c5cd5152 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.004s
I20260807 18:14:37.408841 25269 raft_consensus.cc:348] T 392abf827ffa42c98fc9e816c5cd5152 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.409137 25269 raft_consensus.cc:374] T 392abf827ffa42c98fc9e816c5cd5152 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:37.409309 25269 raft_consensus.cc:729] T 392abf827ffa42c98fc9e816c5cd5152 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:37.409782 25269 consensus_queue.cc:260] T 392abf827ffa42c98fc9e816c5cd5152 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.410077 25269 raft_consensus.cc:388] T 392abf827ffa42c98fc9e816c5cd5152 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:37.409983 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.010s user 0.010s sys 0.000s Metrics: {"bytes_written":5158,"cfile_init":1,"dirs.queue_time_us":65,"dirs.run_cpu_time_us":236,"dirs.run_wall_time_us":1153,"drs_written":1,"lbm_read_time_us":120,"lbm_reads_lt_1ms":4,"lbm_write_time_us":715,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:37.410308 25269 raft_consensus.cc:482] T 392abf827ffa42c98fc9e816c5cd5152 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:37.410445 25269 raft_consensus.cc:3037] T 392abf827ffa42c98fc9e816c5cd5152 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:37.410785 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 235 bytes on disk
I20260807 18:14:37.411288 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":61,"lbm_reads_lt_1ms":4}
I20260807 18:14:37.411995 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.190334
I20260807 18:14:37.414732 25269 raft_consensus.cc:504] T 392abf827ffa42c98fc9e816c5cd5152 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.415143 25269 leader_election.cc:302] T 392abf827ffa42c98fc9e816c5cd5152 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:37.415508 25269 leader_election.cc:288] T 392abf827ffa42c98fc9e816c5cd5152 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:37.415596 25276 raft_consensus.cc:2781] T 392abf827ffa42c98fc9e816c5cd5152 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:37.415931 25276 raft_consensus.cc:686] T 392abf827ffa42c98fc9e816c5cd5152 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:37.416260 25276 consensus_queue.cc:237] T 392abf827ffa42c98fc9e816c5cd5152 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.417821 25269 ts_tablet_manager.cc:1428] T 392abf827ffa42c98fc9e816c5cd5152 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.010s user 0.005s sys 0.004s
I20260807 18:14:37.428401 24956 catalog_manager.cc:5495] T 392abf827ffa42c98fc9e816c5cd5152 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:37.428821 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.040s user 0.026s sys 0.012s Metrics: {"bytes_written":54167,"cfile_cache_hit":13,"cfile_cache_hit_bytes":42131,"cfile_cache_miss":31,"cfile_cache_miss_bytes":62719,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":777,"dirs.run_cpu_time_us":171,"dirs.run_wall_time_us":1531,"drs_written":1,"lbm_read_time_us":1416,"lbm_reads_lt_1ms":63,"lbm_write_time_us":1668,"lbm_writes_lt_1ms":28,"mutex_wait_us":179,"num_input_rowsets":2,"peak_mem_usage":31405,"rows_written":223}
I20260807 18:14:37.429868 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9665 bytes on disk
I20260807 18:14:37.430774 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":84,"lbm_reads_lt_1ms":4}
I20260807 18:14:37.431362 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000013
I20260807 18:14:37.446578 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.015s user 0.006s sys 0.007s Metrics: {"bytes_written":334,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":46,"dirs.run_cpu_time_us":218,"dirs.run_wall_time_us":1168,"drs_written":1,"lbm_read_time_us":87,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1436,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":2,"update_count":1}
I20260807 18:14:37.447585 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 235 bytes on disk
I20260807 18:14:37.448228 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":68,"lbm_reads_lt_1ms":4}
I20260807 18:14:37.448856 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.461964
I20260807 18:14:37.449704 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.037s user 0.033s sys 0.000s Metrics: {"bytes_written":336,"cfile_cache_hit":12,"cfile_cache_hit_bytes":42466,"cfile_cache_miss":28,"cfile_cache_miss_bytes":62526,"cfile_init":7,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":815,"dirs.run_cpu_time_us":194,"dirs.run_wall_time_us":1252,"drs_written":1,"lbm_read_time_us":1150,"lbm_reads_lt_1ms":56,"lbm_write_time_us":1452,"lbm_writes_lt_1ms":32,"mutex_wait_us":150,"num_input_rowsets":2,"peak_mem_usage":31871,"reinsert_count":0,"rows_written":225,"spinlock_wait_cycles":29312,"update_count":1}
I20260807 18:14:37.450670 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9727 bytes on disk
I20260807 18:14:37.451223 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":65,"lbm_reads_lt_1ms":4}
I20260807 18:14:37.457870 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.009s user 0.008s sys 0.000s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":578,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":184,"lbm_read_time_us":401,"lbm_reads_lt_1ms":21,"lbm_write_time_us":280,"lbm_writes_lt_1ms":9,"reinsert_count":0,"update_count":1}
I20260807 18:14:37.458390 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.196669
I20260807 18:14:37.478065 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50020:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.112"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:37.492980 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 853ed5e5fa5046fc9ad4dd54cbbe1b08 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.112 [id=d5325e395251416f83a5edcb06e084aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:37.493732 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 853ed5e5fa5046fc9ad4dd54cbbe1b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:37.495230 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.036s user 0.034s sys 0.001s Metrics: {"bytes_written":54633,"cfile_cache_hit":13,"cfile_cache_hit_bytes":42537,"cfile_cache_miss":31,"cfile_cache_miss_bytes":62985,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":2189,"dirs.run_cpu_time_us":573,"dirs.run_wall_time_us":3918,"drs_written":1,"lbm_read_time_us":1810,"lbm_reads_lt_1ms":63,"lbm_write_time_us":1258,"lbm_writes_lt_1ms":28,"mutex_wait_us":33,"num_input_rowsets":2,"peak_mem_usage":32057,"rows_written":225,"spinlock_wait_cycles":37504,"thread_start_us":375,"threads_started":1}
I20260807 18:14:37.496500 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9743 bytes on disk
I20260807 18:14:37.497517 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":122,"lbm_reads_lt_1ms":4}
I20260807 18:14:37.498260 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000014
I20260807 18:14:37.502033 25269 tablet_bootstrap.cc:492] T 853ed5e5fa5046fc9ad4dd54cbbe1b08 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:37.504748 25269 tablet_bootstrap.cc:654] T 853ed5e5fa5046fc9ad4dd54cbbe1b08 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:37.507915 25269 tablet_bootstrap.cc:492] T 853ed5e5fa5046fc9ad4dd54cbbe1b08 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:37.508142 25269 ts_tablet_manager.cc:1397] T 853ed5e5fa5046fc9ad4dd54cbbe1b08 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 18:14:37.509030 25269 raft_consensus.cc:348] T 853ed5e5fa5046fc9ad4dd54cbbe1b08 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.509099 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.011s user 0.002s sys 0.006s Metrics: {"bytes_written":5158,"cfile_init":1,"dirs.queue_time_us":108,"dirs.run_cpu_time_us":196,"dirs.run_wall_time_us":1008,"drs_written":1,"lbm_read_time_us":69,"lbm_reads_lt_1ms":4,"lbm_write_time_us":839,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:37.509394 25269 raft_consensus.cc:374] T 853ed5e5fa5046fc9ad4dd54cbbe1b08 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:37.509605 25269 raft_consensus.cc:729] T 853ed5e5fa5046fc9ad4dd54cbbe1b08 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:37.509994 25269 consensus_queue.cc:260] T 853ed5e5fa5046fc9ad4dd54cbbe1b08 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.510085 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 235 bytes on disk
I20260807 18:14:37.510324 25269 raft_consensus.cc:388] T 853ed5e5fa5046fc9ad4dd54cbbe1b08 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:37.510501 25269 raft_consensus.cc:482] T 853ed5e5fa5046fc9ad4dd54cbbe1b08 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:37.510696 25269 raft_consensus.cc:3037] T 853ed5e5fa5046fc9ad4dd54cbbe1b08 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:37.510928 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":107,"lbm_reads_lt_1ms":4}
I20260807 18:14:37.511538 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.162934
I20260807 18:14:37.513190 25269 raft_consensus.cc:504] T 853ed5e5fa5046fc9ad4dd54cbbe1b08 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.513514 25269 leader_election.cc:302] T 853ed5e5fa5046fc9ad4dd54cbbe1b08 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:37.513783 25269 leader_election.cc:288] T 853ed5e5fa5046fc9ad4dd54cbbe1b08 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:37.514062 25276 raft_consensus.cc:2781] T 853ed5e5fa5046fc9ad4dd54cbbe1b08 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:37.514400 25276 raft_consensus.cc:686] T 853ed5e5fa5046fc9ad4dd54cbbe1b08 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:37.514410 25269 ts_tablet_manager.cc:1428] T 853ed5e5fa5046fc9ad4dd54cbbe1b08 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260807 18:14:37.514761 25276 consensus_queue.cc:237] T 853ed5e5fa5046fc9ad4dd54cbbe1b08 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.525028 24956 catalog_manager.cc:5495] T 853ed5e5fa5046fc9ad4dd54cbbe1b08 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:37.545957 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.034s user 0.030s sys 0.004s Metrics: {"bytes_written":55019,"cfile_cache_hit":12,"cfile_cache_hit_bytes":42841,"cfile_cache_miss":28,"cfile_cache_miss_bytes":63093,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":994,"dirs.run_cpu_time_us":230,"dirs.run_wall_time_us":1293,"drs_written":1,"lbm_read_time_us":1084,"lbm_reads_lt_1ms":56,"lbm_write_time_us":1566,"lbm_writes_lt_1ms":28,"mutex_wait_us":199,"num_input_rowsets":2,"peak_mem_usage":32126,"rows_written":227}
I20260807 18:14:37.547286 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.000003
I20260807 18:14:37.553244 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.006s user 0.000s sys 0.003s Metrics: {"bytes_written":336,"delete_count":0,"lbm_write_time_us":207,"lbm_writes_lt_1ms":4,"reinsert_count":0,"update_count":1}
I20260807 18:14:37.553887 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9809 bytes on disk
I20260807 18:14:37.554550 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":99,"lbm_reads_lt_1ms":4}
I20260807 18:14:37.580833 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50028:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.113"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:37.593538 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 8126704c13204a878c8fa033ff1dc1c7 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.113 [id=deb50fb5e79446b4873706372e13e5a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:37.594185 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8126704c13204a878c8fa033ff1dc1c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:37.600157 25269 tablet_bootstrap.cc:492] T 8126704c13204a878c8fa033ff1dc1c7 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:37.602028 25269 tablet_bootstrap.cc:654] T 8126704c13204a878c8fa033ff1dc1c7 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:37.638115 25269 tablet_bootstrap.cc:492] T 8126704c13204a878c8fa033ff1dc1c7 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:37.638335 25269 ts_tablet_manager.cc:1397] T 8126704c13204a878c8fa033ff1dc1c7 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.000s
I20260807 18:14:37.639294 25269 raft_consensus.cc:348] T 8126704c13204a878c8fa033ff1dc1c7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.639575 25269 raft_consensus.cc:374] T 8126704c13204a878c8fa033ff1dc1c7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:37.639693 25269 raft_consensus.cc:729] T 8126704c13204a878c8fa033ff1dc1c7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:37.639974 25269 consensus_queue.cc:260] T 8126704c13204a878c8fa033ff1dc1c7 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.640161 25269 raft_consensus.cc:388] T 8126704c13204a878c8fa033ff1dc1c7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:37.640260 25269 raft_consensus.cc:482] T 8126704c13204a878c8fa033ff1dc1c7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:37.640353 25269 raft_consensus.cc:3037] T 8126704c13204a878c8fa033ff1dc1c7 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:37.642953 25269 raft_consensus.cc:504] T 8126704c13204a878c8fa033ff1dc1c7 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.643287 25269 leader_election.cc:302] T 8126704c13204a878c8fa033ff1dc1c7 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:37.643735 25269 leader_election.cc:288] T 8126704c13204a878c8fa033ff1dc1c7 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:37.643795 25276 raft_consensus.cc:2781] T 8126704c13204a878c8fa033ff1dc1c7 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:37.644107 25276 raft_consensus.cc:686] T 8126704c13204a878c8fa033ff1dc1c7 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:37.644434 25269 ts_tablet_manager.cc:1428] T 8126704c13204a878c8fa033ff1dc1c7 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260807 18:14:37.644421 25276 consensus_queue.cc:237] T 8126704c13204a878c8fa033ff1dc1c7 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.651880 24956 catalog_manager.cc:5495] T 8126704c13204a878c8fa033ff1dc1c7 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:37.702108 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000081
I20260807 18:14:37.703590 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50032:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.114"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:37.714690 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.010s sys 0.000s Metrics: {"bytes_written":5626,"cfile_init":1,"dirs.queue_time_us":60,"dirs.run_cpu_time_us":281,"dirs.run_wall_time_us":1295,"drs_written":1,"lbm_read_time_us":87,"lbm_reads_lt_1ms":4,"lbm_write_time_us":836,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":4}
I20260807 18:14:37.715605 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.170541
I20260807 18:14:37.717206 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 056311b2dbbf48abbbc4efbe5a318dba (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.114 [id=141637953cd447cc96c9a398ac361e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:37.717810 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 056311b2dbbf48abbbc4efbe5a318dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:37.724892 25269 tablet_bootstrap.cc:492] T 056311b2dbbf48abbbc4efbe5a318dba P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:37.727888 25269 tablet_bootstrap.cc:654] T 056311b2dbbf48abbbc4efbe5a318dba P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:37.734730 25269 tablet_bootstrap.cc:492] T 056311b2dbbf48abbbc4efbe5a318dba P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:37.734982 25269 ts_tablet_manager.cc:1397] T 056311b2dbbf48abbbc4efbe5a318dba P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260807 18:14:37.736369 25269 raft_consensus.cc:348] T 056311b2dbbf48abbbc4efbe5a318dba P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.736744 25269 raft_consensus.cc:374] T 056311b2dbbf48abbbc4efbe5a318dba P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:37.736985 25269 raft_consensus.cc:729] T 056311b2dbbf48abbbc4efbe5a318dba P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:37.737274 25269 consensus_queue.cc:260] T 056311b2dbbf48abbbc4efbe5a318dba P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.737571 25269 raft_consensus.cc:388] T 056311b2dbbf48abbbc4efbe5a318dba P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:37.737665 25269 raft_consensus.cc:482] T 056311b2dbbf48abbbc4efbe5a318dba P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:37.737900 25269 raft_consensus.cc:3037] T 056311b2dbbf48abbbc4efbe5a318dba P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:37.741803 25269 raft_consensus.cc:504] T 056311b2dbbf48abbbc4efbe5a318dba P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.742261 25269 leader_election.cc:302] T 056311b2dbbf48abbbc4efbe5a318dba P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:37.742601 25269 leader_election.cc:288] T 056311b2dbbf48abbbc4efbe5a318dba P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:37.742795 25276 raft_consensus.cc:2781] T 056311b2dbbf48abbbc4efbe5a318dba P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:37.743001 25276 raft_consensus.cc:686] T 056311b2dbbf48abbbc4efbe5a318dba P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:37.743485 25269 ts_tablet_manager.cc:1428] T 056311b2dbbf48abbbc4efbe5a318dba P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260807 18:14:37.743386 25276 consensus_queue.cc:237] T 056311b2dbbf48abbbc4efbe5a318dba P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.752717 24957 catalog_manager.cc:5495] T 056311b2dbbf48abbbc4efbe5a318dba P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:37.753001 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.037s user 0.035s sys 0.002s Metrics: {"bytes_written":55502,"cfile_cache_hit":13,"cfile_cache_hit_bytes":43238,"cfile_cache_miss":31,"cfile_cache_miss_bytes":64256,"cfile_init":9,"delta_iterators_relevant":6,"dirs.queue_time_us":867,"dirs.run_cpu_time_us":236,"dirs.run_wall_time_us":1534,"drs_written":1,"lbm_read_time_us":1271,"lbm_reads_lt_1ms":67,"lbm_write_time_us":1613,"lbm_writes_lt_1ms":28,"mutex_wait_us":214,"num_input_rowsets":2,"peak_mem_usage":32598,"rows_written":229}
I20260807 18:14:37.754222 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9891 bytes on disk
I20260807 18:14:37.754855 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":75,"lbm_reads_lt_1ms":4}
I20260807 18:14:37.755533 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000011
I20260807 18:14:37.770004 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.014s user 0.007s sys 0.006s Metrics: {"bytes_written":334,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":41,"dirs.run_cpu_time_us":175,"dirs.run_wall_time_us":965,"drs_written":1,"lbm_read_time_us":95,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1529,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":2,"update_count":1}
I20260807 18:14:37.770958 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.461964
I20260807 18:14:37.778738 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.007s user 0.002s sys 0.004s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":578,"cfile_init":5,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":223,"lbm_read_time_us":379,"lbm_reads_lt_1ms":25,"lbm_write_time_us":276,"lbm_writes_lt_1ms":9,"reinsert_count":0,"update_count":1}
I20260807 18:14:37.779313 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.195526
I20260807 18:14:37.804654 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50036:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.115"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:37.805550 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000082
I20260807 18:14:37.821432 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 2c794e054dae48028d15ec415acbf349 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.115 [id=948fb10268a84cb7b76e7385ee8c8458]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:37.821622 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.016s user 0.012s sys 0.002s Metrics: {"bytes_written":5628,"cfile_init":1,"dirs.queue_time_us":1002,"dirs.run_cpu_time_us":175,"dirs.run_wall_time_us":1217,"drs_written":1,"lbm_read_time_us":82,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1346,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":4}
I20260807 18:14:37.822006 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c794e054dae48028d15ec415acbf349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:37.822681 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 439 bytes on disk
I20260807 18:14:37.823450 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":98,"lbm_reads_lt_1ms":4}
I20260807 18:14:37.824304 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.201678
I20260807 18:14:37.827865 25269 tablet_bootstrap.cc:492] T 2c794e054dae48028d15ec415acbf349 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:37.828624 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.042s user 0.037s sys 0.000s Metrics: {"bytes_written":55929,"cfile_cache_hit":13,"cfile_cache_hit_bytes":43652,"cfile_cache_miss":31,"cfile_cache_miss_bytes":64588,"cfile_init":9,"delta_iterators_relevant":6,"dirs.queue_time_us":1488,"dirs.run_cpu_time_us":1178,"dirs.run_wall_time_us":6509,"drs_written":1,"lbm_read_time_us":1511,"lbm_reads_lt_1ms":67,"lbm_write_time_us":1440,"lbm_writes_lt_1ms":29,"mutex_wait_us":401,"num_input_rowsets":2,"peak_mem_usage":32822,"rows_written":231,"thread_start_us":3951,"threads_started":1}
I20260807 18:14:37.829638 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000017
I20260807 18:14:37.829741 25269 tablet_bootstrap.cc:654] T 2c794e054dae48028d15ec415acbf349 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:37.832896 25269 tablet_bootstrap.cc:492] T 2c794e054dae48028d15ec415acbf349 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:37.833088 25269 ts_tablet_manager.cc:1397] T 2c794e054dae48028d15ec415acbf349 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 18:14:37.833992 25269 raft_consensus.cc:348] T 2c794e054dae48028d15ec415acbf349 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.834236 25269 raft_consensus.cc:374] T 2c794e054dae48028d15ec415acbf349 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:37.834354 25269 raft_consensus.cc:729] T 2c794e054dae48028d15ec415acbf349 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:37.834653 25269 consensus_queue.cc:260] T 2c794e054dae48028d15ec415acbf349 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.834857 25269 raft_consensus.cc:388] T 2c794e054dae48028d15ec415acbf349 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:37.835003 25269 raft_consensus.cc:482] T 2c794e054dae48028d15ec415acbf349 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:37.835140 25269 raft_consensus.cc:3037] T 2c794e054dae48028d15ec415acbf349 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:37.837517 25269 raft_consensus.cc:504] T 2c794e054dae48028d15ec415acbf349 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.838017 25269 leader_election.cc:302] T 2c794e054dae48028d15ec415acbf349 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:37.838376 25276 raft_consensus.cc:2781] T 2c794e054dae48028d15ec415acbf349 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:37.838289 25269 leader_election.cc:288] T 2c794e054dae48028d15ec415acbf349 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:37.838606 25276 raft_consensus.cc:686] T 2c794e054dae48028d15ec415acbf349 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:37.838872 25276 consensus_queue.cc:237] T 2c794e054dae48028d15ec415acbf349 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.839046 25269 ts_tablet_manager.cc:1428] T 2c794e054dae48028d15ec415acbf349 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260807 18:14:37.846202 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.016s user 0.009s sys 0.003s Metrics: {"bytes_written":5158,"cfile_init":1,"dirs.queue_time_us":53,"dirs.run_cpu_time_us":283,"dirs.run_wall_time_us":1345,"drs_written":1,"lbm_read_time_us":86,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1430,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2,"spinlock_wait_cycles":56832}
I20260807 18:14:37.847288 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.185625
I20260807 18:14:37.848994 24957 catalog_manager.cc:5495] T 2c794e054dae48028d15ec415acbf349 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:37.879607 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.055s user 0.039s sys 0.009s Metrics: {"bytes_written":55929,"cfile_cache_hit":13,"cfile_cache_hit_bytes":43603,"cfile_cache_miss":31,"cfile_cache_miss_bytes":64783,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":472,"dirs.run_cpu_time_us":196,"dirs.run_wall_time_us":1376,"drs_written":1,"lbm_read_time_us":1937,"lbm_reads_lt_1ms":63,"lbm_write_time_us":1643,"lbm_writes_lt_1ms":29,"num_input_rowsets":2,"peak_mem_usage":32853,"rows_written":231}
I20260807 18:14:37.880512 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000016
I20260807 18:14:37.883167 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.036s user 0.029s sys 0.004s Metrics: {"bytes_written":336,"cfile_cache_hit":12,"cfile_cache_hit_bytes":43964,"cfile_cache_miss":30,"cfile_cache_miss_bytes":64732,"cfile_init":9,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":732,"dirs.run_cpu_time_us":201,"dirs.run_wall_time_us":1033,"drs_written":1,"lbm_read_time_us":1543,"lbm_reads_lt_1ms":66,"lbm_write_time_us":1680,"lbm_writes_lt_1ms":33,"mutex_wait_us":171,"num_input_rowsets":2,"peak_mem_usage":32874,"reinsert_count":0,"rows_written":233,"spinlock_wait_cycles":7936,"update_count":1}
I20260807 18:14:37.884155 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10087 bytes on disk
I20260807 18:14:37.884651 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":76,"lbm_reads_lt_1ms":4}
I20260807 18:14:37.891932 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.011s user 0.008s sys 0.000s Metrics: {"bytes_written":5195,"cfile_init":1,"dirs.queue_time_us":50,"dirs.run_cpu_time_us":127,"dirs.run_wall_time_us":876,"drs_written":1,"lbm_read_time_us":107,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1017,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:37.892717 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10377 bytes on disk
I20260807 18:14:37.893477 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":180,"lbm_reads_lt_1ms":8}
I20260807 18:14:37.894050 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.186312
I20260807 18:14:37.900568 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50042:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.116"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:37.915539 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 425766a471bc4242bf87a0369662b9a8 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.116 [id=046c3927988a4128b76a327f10462ca6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:37.915990 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 425766a471bc4242bf87a0369662b9a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:37.920714 25269 tablet_bootstrap.cc:492] T 425766a471bc4242bf87a0369662b9a8 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:37.922622 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.028s user 0.028s sys 0.000s Metrics: {"bytes_written":56377,"cfile_cache_hit":12,"cfile_cache_hit_bytes":44002,"cfile_cache_miss":30,"cfile_cache_miss_bytes":65012,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":390,"dirs.run_cpu_time_us":232,"dirs.run_wall_time_us":1369,"drs_written":1,"lbm_read_time_us":1153,"lbm_reads_lt_1ms":58,"lbm_write_time_us":1150,"lbm_writes_lt_1ms":29,"mutex_wait_us":74,"num_input_rowsets":2,"peak_mem_usage":33043,"rows_written":233,"spinlock_wait_cycles":18432}
I20260807 18:14:37.922974 25269 tablet_bootstrap.cc:654] T 425766a471bc4242bf87a0369662b9a8 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:37.923463 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10143 bytes on disk
I20260807 18:14:37.923930 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":62,"lbm_reads_lt_1ms":4}
I20260807 18:14:37.924466 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000009
I20260807 18:14:37.927687 25269 tablet_bootstrap.cc:492] T 425766a471bc4242bf87a0369662b9a8 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:37.927902 25269 ts_tablet_manager.cc:1397] T 425766a471bc4242bf87a0369662b9a8 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 18:14:37.929090 25269 raft_consensus.cc:348] T 425766a471bc4242bf87a0369662b9a8 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.929368 25269 raft_consensus.cc:374] T 425766a471bc4242bf87a0369662b9a8 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:37.929577 25269 raft_consensus.cc:729] T 425766a471bc4242bf87a0369662b9a8 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:37.929956 25269 consensus_queue.cc:260] T 425766a471bc4242bf87a0369662b9a8 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.930315 25269 raft_consensus.cc:388] T 425766a471bc4242bf87a0369662b9a8 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:37.930487 25269 raft_consensus.cc:482] T 425766a471bc4242bf87a0369662b9a8 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:37.930681 25269 raft_consensus.cc:3037] T 425766a471bc4242bf87a0369662b9a8 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:37.933702 25269 raft_consensus.cc:504] T 425766a471bc4242bf87a0369662b9a8 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.934012 25269 leader_election.cc:302] T 425766a471bc4242bf87a0369662b9a8 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:37.934381 25276 raft_consensus.cc:2781] T 425766a471bc4242bf87a0369662b9a8 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:37.934644 25276 raft_consensus.cc:686] T 425766a471bc4242bf87a0369662b9a8 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:37.935088 25276 consensus_queue.cc:237] T 425766a471bc4242bf87a0369662b9a8 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:37.935990 25269 leader_election.cc:288] T 425766a471bc4242bf87a0369662b9a8 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:37.936676 25269 ts_tablet_manager.cc:1428] T 425766a471bc4242bf87a0369662b9a8 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.009s user 0.004s sys 0.004s
I20260807 18:14:37.936790 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.009s sys 0.000s Metrics: {"bytes_written":5158,"cfile_init":1,"dirs.queue_time_us":73,"dirs.run_cpu_time_us":206,"dirs.run_wall_time_us":1190,"drs_written":1,"lbm_read_time_us":87,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1101,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:37.941269 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.192210
I20260807 18:14:37.942397 24957 catalog_manager.cc:5495] T 425766a471bc4242bf87a0369662b9a8 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:37.977775 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.036s user 0.032s sys 0.003s Metrics: {"bytes_written":389,"cfile_cache_hit":12,"cfile_cache_hit_bytes":44340,"cfile_cache_miss":30,"cfile_cache_miss_bytes":65366,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":674,"dirs.run_cpu_time_us":178,"dirs.run_wall_time_us":1453,"drs_written":1,"lbm_read_time_us":1405,"lbm_reads_lt_1ms":62,"lbm_write_time_us":1864,"lbm_writes_lt_1ms":33,"mutex_wait_us":181,"num_input_rowsets":2,"peak_mem_usage":33059,"reinsert_count":0,"rows_written":235,"spinlock_wait_cycles":1664,"update_count":2}
I20260807 18:14:37.978793 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10317 bytes on disk
I20260807 18:14:37.980568 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":87,"lbm_reads_lt_1ms":4}
I20260807 18:14:38.012009 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50044:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.117"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:38.026638 25147 tablet_service.cc:1467] Processing CreateTablet for tablet bc85eb30cd4d40688b97f523d377e97d (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.117 [id=12dc6b6cefed4998978181e023dd5bf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:38.027225 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc85eb30cd4d40688b97f523d377e97d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:38.035271 25269 tablet_bootstrap.cc:492] T bc85eb30cd4d40688b97f523d377e97d P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:38.037684 25269 tablet_bootstrap.cc:654] T bc85eb30cd4d40688b97f523d377e97d P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:38.041520 25269 tablet_bootstrap.cc:492] T bc85eb30cd4d40688b97f523d377e97d P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:38.041821 25269 ts_tablet_manager.cc:1397] T bc85eb30cd4d40688b97f523d377e97d P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.004s
I20260807 18:14:38.042752 25269 raft_consensus.cc:348] T bc85eb30cd4d40688b97f523d377e97d P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.043160 25269 raft_consensus.cc:374] T bc85eb30cd4d40688b97f523d377e97d P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:38.043370 25269 raft_consensus.cc:729] T bc85eb30cd4d40688b97f523d377e97d P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:38.043844 25269 consensus_queue.cc:260] T bc85eb30cd4d40688b97f523d377e97d P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.044061 25269 raft_consensus.cc:388] T bc85eb30cd4d40688b97f523d377e97d P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:38.044272 25269 raft_consensus.cc:482] T bc85eb30cd4d40688b97f523d377e97d P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:38.044406 25269 raft_consensus.cc:3037] T bc85eb30cd4d40688b97f523d377e97d P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:38.046834 25269 raft_consensus.cc:504] T bc85eb30cd4d40688b97f523d377e97d P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.047104 25269 leader_election.cc:302] T bc85eb30cd4d40688b97f523d377e97d P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:38.047413 25269 leader_election.cc:288] T bc85eb30cd4d40688b97f523d377e97d P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:38.047468 25276 raft_consensus.cc:2781] T bc85eb30cd4d40688b97f523d377e97d P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:38.047684 25276 raft_consensus.cc:686] T bc85eb30cd4d40688b97f523d377e97d P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:38.048053 25269 ts_tablet_manager.cc:1428] T bc85eb30cd4d40688b97f523d377e97d P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.001s sys 0.003s
I20260807 18:14:38.047950 25276 consensus_queue.cc:237] T bc85eb30cd4d40688b97f523d377e97d P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.062527 24956 catalog_manager.cc:5495] T bc85eb30cd4d40688b97f523d377e97d P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:38.106556 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50054:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.118"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:38.118134 25147 tablet_service.cc:1467] Processing CreateTablet for tablet e2522648499e4f779ee749a2426accd8 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.118 [id=15d00cabcf954279a56b732abbb3ee14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:38.118593 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2522648499e4f779ee749a2426accd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:38.123618 25269 tablet_bootstrap.cc:492] T e2522648499e4f779ee749a2426accd8 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:38.125819 25269 tablet_bootstrap.cc:654] T e2522648499e4f779ee749a2426accd8 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:38.129395 25269 tablet_bootstrap.cc:492] T e2522648499e4f779ee749a2426accd8 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:38.129529 25269 ts_tablet_manager.cc:1397] T e2522648499e4f779ee749a2426accd8 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20260807 18:14:38.130569 25269 raft_consensus.cc:348] T e2522648499e4f779ee749a2426accd8 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.130806 25269 raft_consensus.cc:374] T e2522648499e4f779ee749a2426accd8 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:38.130965 25269 raft_consensus.cc:729] T e2522648499e4f779ee749a2426accd8 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:38.131220 25269 consensus_queue.cc:260] T e2522648499e4f779ee749a2426accd8 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.131487 25269 raft_consensus.cc:388] T e2522648499e4f779ee749a2426accd8 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:38.131600 25269 raft_consensus.cc:482] T e2522648499e4f779ee749a2426accd8 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:38.131779 25269 raft_consensus.cc:3037] T e2522648499e4f779ee749a2426accd8 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:38.134440 25269 raft_consensus.cc:504] T e2522648499e4f779ee749a2426accd8 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.134778 25269 leader_election.cc:302] T e2522648499e4f779ee749a2426accd8 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:38.135007 25269 leader_election.cc:288] T e2522648499e4f779ee749a2426accd8 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:38.135097 25276 raft_consensus.cc:2781] T e2522648499e4f779ee749a2426accd8 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:38.135301 25276 raft_consensus.cc:686] T e2522648499e4f779ee749a2426accd8 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:38.135871 25276 consensus_queue.cc:237] T e2522648499e4f779ee749a2426accd8 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.136018 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000080
I20260807 18:14:38.137034 25269 ts_tablet_manager.cc:1428] T e2522648499e4f779ee749a2426accd8 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.000s sys 0.006s
I20260807 18:14:38.144412 24956 catalog_manager.cc:5495] T e2522648499e4f779ee749a2426accd8 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:38.149138 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.013s user 0.011s sys 0.000s Metrics: {"bytes_written":6031,"cfile_init":1,"dirs.queue_time_us":75,"dirs.run_cpu_time_us":224,"dirs.run_wall_time_us":1343,"drs_written":1,"lbm_read_time_us":90,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1269,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:38.150166 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.235163
I20260807 18:14:38.187274 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.036s user 0.026s sys 0.010s Metrics: {"bytes_written":336,"cfile_cache_hit":13,"cfile_cache_hit_bytes":45072,"cfile_cache_miss":33,"cfile_cache_miss_bytes":66980,"cfile_init":9,"delete_count":0,"delta_iterators_relevant":6,"dirs.queue_time_us":1018,"dirs.run_cpu_time_us":228,"dirs.run_wall_time_us":1168,"drs_written":1,"lbm_read_time_us":2005,"lbm_reads_lt_1ms":69,"lbm_write_time_us":1824,"lbm_writes_lt_1ms":33,"mutex_wait_us":186,"num_input_rowsets":2,"peak_mem_usage":33914,"reinsert_count":0,"rows_written":239,"spinlock_wait_cycles":2560,"update_count":1}
I20260807 18:14:38.188546 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10519 bytes on disk
I20260807 18:14:38.189872 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":89,"lbm_reads_lt_1ms":4}
I20260807 18:14:38.190629 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50056:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.119"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:38.204267 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 3a8e9b2f4439456285041577b253e25f (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.119 [id=c6b45a427fb548aba2722b7cc2558afb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:38.204876 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a8e9b2f4439456285041577b253e25f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:38.210898 25269 tablet_bootstrap.cc:492] T 3a8e9b2f4439456285041577b253e25f P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:38.212908 25269 tablet_bootstrap.cc:654] T 3a8e9b2f4439456285041577b253e25f P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:38.218029 25269 tablet_bootstrap.cc:492] T 3a8e9b2f4439456285041577b253e25f P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:38.218307 25269 ts_tablet_manager.cc:1397] T 3a8e9b2f4439456285041577b253e25f P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260807 18:14:38.219206 25269 raft_consensus.cc:348] T 3a8e9b2f4439456285041577b253e25f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.219507 25269 raft_consensus.cc:374] T 3a8e9b2f4439456285041577b253e25f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:38.219677 25269 raft_consensus.cc:729] T 3a8e9b2f4439456285041577b253e25f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:38.219954 25269 consensus_queue.cc:260] T 3a8e9b2f4439456285041577b253e25f P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.220286 25269 raft_consensus.cc:388] T 3a8e9b2f4439456285041577b253e25f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:38.220528 25269 raft_consensus.cc:482] T 3a8e9b2f4439456285041577b253e25f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:38.220675 25269 raft_consensus.cc:3037] T 3a8e9b2f4439456285041577b253e25f P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:38.223294 25269 raft_consensus.cc:504] T 3a8e9b2f4439456285041577b253e25f P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.223605 25269 leader_election.cc:302] T 3a8e9b2f4439456285041577b253e25f P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:38.223973 25269 leader_election.cc:288] T 3a8e9b2f4439456285041577b253e25f P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:38.224032 25276 raft_consensus.cc:2781] T 3a8e9b2f4439456285041577b253e25f P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:38.224314 25276 raft_consensus.cc:686] T 3a8e9b2f4439456285041577b253e25f P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:38.224622 25269 ts_tablet_manager.cc:1428] T 3a8e9b2f4439456285041577b253e25f P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.000s sys 0.004s
I20260807 18:14:38.224607 25276 consensus_queue.cc:237] T 3a8e9b2f4439456285041577b253e25f P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.230996 24956 catalog_manager.cc:5495] T 3a8e9b2f4439456285041577b253e25f P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:38.231853 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000082
I20260807 18:14:38.245862 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.014s user 0.009s sys 0.004s Metrics: {"bytes_written":336,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":67,"dirs.run_cpu_time_us":302,"dirs.run_wall_time_us":1393,"drs_written":1,"lbm_read_time_us":125,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1431,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":6,"spinlock_wait_cycles":30592,"update_count":1}
I20260807 18:14:38.246627 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 512 bytes on disk
I20260807 18:14:38.247193 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":76,"lbm_reads_lt_1ms":4}
I20260807 18:14:38.247716 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.239932
I20260807 18:14:38.275050 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50072:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.120"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:38.287309 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.039s user 0.021s sys 0.016s Metrics: {"bytes_written":58128,"cfile_cache_hit":14,"cfile_cache_hit_bytes":45472,"cfile_cache_miss":36,"cfile_cache_miss_bytes":68300,"cfile_init":9,"delta_iterators_relevant":8,"dirs.queue_time_us":1064,"dirs.run_cpu_time_us":1334,"dirs.run_wall_time_us":8041,"drs_written":1,"lbm_read_time_us":1181,"lbm_reads_lt_1ms":72,"lbm_write_time_us":1594,"lbm_writes_lt_1ms":29,"mutex_wait_us":219,"num_input_rowsets":2,"peak_mem_usage":34390,"rows_written":241,"spinlock_wait_cycles":13056,"thread_start_us":1202,"threads_started":1}
I20260807 18:14:38.288314 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10592 bytes on disk
I20260807 18:14:38.289475 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":94,"lbm_reads_lt_1ms":4}
I20260807 18:14:38.290242 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000012
I20260807 18:14:38.290190 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 3157715e9e2a495a98a595306bc4feab (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.120 [id=2e6335a432e746239a463bf160b78696]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:38.290894 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3157715e9e2a495a98a595306bc4feab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:38.300135 25269 tablet_bootstrap.cc:492] T 3157715e9e2a495a98a595306bc4feab P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:38.302214 25269 tablet_bootstrap.cc:654] T 3157715e9e2a495a98a595306bc4feab P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:38.305286 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.015s user 0.008s sys 0.003s Metrics: {"bytes_written":5158,"cfile_init":1,"dirs.queue_time_us":111,"dirs.run_cpu_time_us":195,"dirs.run_wall_time_us":1720,"drs_written":1,"lbm_read_time_us":110,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1570,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:38.305648 25269 tablet_bootstrap.cc:492] T 3157715e9e2a495a98a595306bc4feab P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:38.305852 25269 ts_tablet_manager.cc:1397] T 3157715e9e2a495a98a595306bc4feab P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260807 18:14:38.306253 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 235 bytes on disk
I20260807 18:14:38.306849 25269 raft_consensus.cc:348] T 3157715e9e2a495a98a595306bc4feab P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.306898 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":101,"lbm_reads_lt_1ms":4}
I20260807 18:14:38.307049 25269 raft_consensus.cc:374] T 3157715e9e2a495a98a595306bc4feab P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:38.307293 25269 raft_consensus.cc:729] T 3157715e9e2a495a98a595306bc4feab P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:38.307576 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.189799
I20260807 18:14:38.307607 25269 consensus_queue.cc:260] T 3157715e9e2a495a98a595306bc4feab P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.307919 25269 raft_consensus.cc:388] T 3157715e9e2a495a98a595306bc4feab P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:38.308097 25269 raft_consensus.cc:482] T 3157715e9e2a495a98a595306bc4feab P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:38.308303 25269 raft_consensus.cc:3037] T 3157715e9e2a495a98a595306bc4feab P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:38.310909 25269 raft_consensus.cc:504] T 3157715e9e2a495a98a595306bc4feab P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.311213 25269 leader_election.cc:302] T 3157715e9e2a495a98a595306bc4feab P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:38.311395 25269 leader_election.cc:288] T 3157715e9e2a495a98a595306bc4feab P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:38.311604 25276 raft_consensus.cc:2781] T 3157715e9e2a495a98a595306bc4feab P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:38.311833 25276 raft_consensus.cc:686] T 3157715e9e2a495a98a595306bc4feab P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:38.311993 25269 ts_tablet_manager.cc:1428] T 3157715e9e2a495a98a595306bc4feab P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.002s sys 0.002s
I20260807 18:14:38.312206 25276 consensus_queue.cc:237] T 3157715e9e2a495a98a595306bc4feab P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.321949 24956 catalog_manager.cc:5495] T 3157715e9e2a495a98a595306bc4feab P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:38.352622 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.045s user 0.044s sys 0.000s Metrics: {"bytes_written":336,"cfile_cache_hit":12,"cfile_cache_hit_bytes":45820,"cfile_cache_miss":30,"cfile_cache_miss_bytes":67748,"cfile_init":7,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":761,"dirs.run_cpu_time_us":209,"dirs.run_wall_time_us":1484,"drs_written":1,"lbm_read_time_us":1453,"lbm_reads_lt_1ms":58,"lbm_write_time_us":1690,"lbm_writes_lt_1ms":33,"mutex_wait_us":4,"num_input_rowsets":2,"peak_mem_usage":34284,"reinsert_count":0,"rows_written":243,"update_count":1}
I20260807 18:14:38.353593 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10697 bytes on disk
I20260807 18:14:38.354118 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":64,"lbm_reads_lt_1ms":4}
I20260807 18:14:38.371096 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50076:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.121"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:38.383967 25147 tablet_service.cc:1467] Processing CreateTablet for tablet c9dd7af2f7f94823806ef24aa8c48830 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.121 [id=890003f4afdb4a7ea21d8ef31052cca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:38.384533 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9dd7af2f7f94823806ef24aa8c48830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:38.390308 25269 tablet_bootstrap.cc:492] T c9dd7af2f7f94823806ef24aa8c48830 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:38.392138 25269 tablet_bootstrap.cc:654] T c9dd7af2f7f94823806ef24aa8c48830 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:38.395077 25269 tablet_bootstrap.cc:492] T c9dd7af2f7f94823806ef24aa8c48830 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:38.395259 25269 ts_tablet_manager.cc:1397] T c9dd7af2f7f94823806ef24aa8c48830 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20260807 18:14:38.395985 25269 raft_consensus.cc:348] T c9dd7af2f7f94823806ef24aa8c48830 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.396196 25269 raft_consensus.cc:374] T c9dd7af2f7f94823806ef24aa8c48830 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:38.396303 25269 raft_consensus.cc:729] T c9dd7af2f7f94823806ef24aa8c48830 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:38.396569 25269 consensus_queue.cc:260] T c9dd7af2f7f94823806ef24aa8c48830 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.396741 25269 raft_consensus.cc:388] T c9dd7af2f7f94823806ef24aa8c48830 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:38.396896 25269 raft_consensus.cc:482] T c9dd7af2f7f94823806ef24aa8c48830 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:38.397017 25269 raft_consensus.cc:3037] T c9dd7af2f7f94823806ef24aa8c48830 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:38.398981 25269 raft_consensus.cc:504] T c9dd7af2f7f94823806ef24aa8c48830 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.399226 25269 leader_election.cc:302] T c9dd7af2f7f94823806ef24aa8c48830 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:38.399461 25269 leader_election.cc:288] T c9dd7af2f7f94823806ef24aa8c48830 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:38.399538 25276 raft_consensus.cc:2781] T c9dd7af2f7f94823806ef24aa8c48830 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:38.399756 25276 raft_consensus.cc:686] T c9dd7af2f7f94823806ef24aa8c48830 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:38.400131 25269 ts_tablet_manager.cc:1428] T c9dd7af2f7f94823806ef24aa8c48830 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 18:14:38.400058 25276 consensus_queue.cc:237] T c9dd7af2f7f94823806ef24aa8c48830 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.406751 24956 catalog_manager.cc:5495] T c9dd7af2f7f94823806ef24aa8c48830 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:38.443169 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000082
I20260807 18:14:38.443910 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50090:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.122"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:38.455921 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.006s sys 0.004s Metrics: {"bytes_written":6068,"cfile_init":1,"dirs.queue_time_us":54,"dirs.run_cpu_time_us":207,"dirs.run_wall_time_us":1630,"drs_written":1,"lbm_read_time_us":93,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1019,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:38.457217 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.232637
I20260807 18:14:38.459108 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 4d27d34f01da4d9f870674ea731d8936 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.122 [id=75b2b8e770b8496b8df13e90ec310a09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:38.459746 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d27d34f01da4d9f870674ea731d8936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:38.466594 25269 tablet_bootstrap.cc:492] T 4d27d34f01da4d9f870674ea731d8936 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:38.468585 25269 tablet_bootstrap.cc:654] T 4d27d34f01da4d9f870674ea731d8936 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:38.472381 25269 tablet_bootstrap.cc:492] T 4d27d34f01da4d9f870674ea731d8936 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:38.472623 25269 ts_tablet_manager.cc:1397] T 4d27d34f01da4d9f870674ea731d8936 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 18:14:38.473574 25269 raft_consensus.cc:348] T 4d27d34f01da4d9f870674ea731d8936 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.473796 25269 raft_consensus.cc:374] T 4d27d34f01da4d9f870674ea731d8936 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:38.473984 25269 raft_consensus.cc:729] T 4d27d34f01da4d9f870674ea731d8936 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:38.474303 25269 consensus_queue.cc:260] T 4d27d34f01da4d9f870674ea731d8936 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.474601 25269 raft_consensus.cc:388] T 4d27d34f01da4d9f870674ea731d8936 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:38.474735 25269 raft_consensus.cc:482] T 4d27d34f01da4d9f870674ea731d8936 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:38.474917 25269 raft_consensus.cc:3037] T 4d27d34f01da4d9f870674ea731d8936 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:38.477133 25269 raft_consensus.cc:504] T 4d27d34f01da4d9f870674ea731d8936 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.477454 25269 leader_election.cc:302] T 4d27d34f01da4d9f870674ea731d8936 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:38.477706 25269 leader_election.cc:288] T 4d27d34f01da4d9f870674ea731d8936 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:38.477883 25276 raft_consensus.cc:2781] T 4d27d34f01da4d9f870674ea731d8936 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:38.478155 25276 raft_consensus.cc:686] T 4d27d34f01da4d9f870674ea731d8936 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:38.478461 25276 consensus_queue.cc:237] T 4d27d34f01da4d9f870674ea731d8936 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.479059 25269 ts_tablet_manager.cc:1428] T 4d27d34f01da4d9f870674ea731d8936 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 18:14:38.486812 24956 catalog_manager.cc:5495] T 4d27d34f01da4d9f870674ea731d8936 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:38.499369 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.042s user 0.028s sys 0.013s Metrics: {"bytes_written":58996,"cfile_cache_hit":13,"cfile_cache_hit_bytes":46215,"cfile_cache_miss":33,"cfile_cache_miss_bytes":68959,"cfile_init":9,"delta_iterators_relevant":6,"dirs.queue_time_us":1017,"dirs.run_cpu_time_us":215,"dirs.run_wall_time_us":1316,"drs_written":1,"lbm_read_time_us":1602,"lbm_reads_lt_1ms":69,"lbm_write_time_us":1816,"lbm_writes_lt_1ms":29,"mutex_wait_us":255,"num_input_rowsets":2,"peak_mem_usage":34854,"rows_written":245,"spinlock_wait_cycles":12416}
I20260807 18:14:38.500399 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000012
I20260807 18:14:38.515877 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.015s user 0.008s sys 0.005s Metrics: {"bytes_written":334,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":72,"dirs.run_cpu_time_us":254,"dirs.run_wall_time_us":1347,"drs_written":1,"lbm_read_time_us":67,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1278,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":2,"update_count":1}
I20260807 18:14:38.516680 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.441215
I20260807 18:14:38.524776 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.008s user 0.005s sys 0.000s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":612,"cfile_init":5,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":241,"lbm_read_time_us":358,"lbm_reads_lt_1ms":25,"lbm_write_time_us":260,"lbm_writes_lt_1ms":9,"reinsert_count":0,"update_count":1}
I20260807 18:14:38.525611 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 11149 bytes on disk
I20260807 18:14:38.526654 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":196,"lbm_reads_lt_1ms":8}
I20260807 18:14:38.527343 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.188001
I20260807 18:14:38.543114 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50092:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.123"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:38.557199 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 091552bf73984f8b946031f5bb855ddd (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.123 [id=ccbb2f583b6d4a17bb7fa1751b98c325]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:38.557763 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 091552bf73984f8b946031f5bb855ddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:38.564886 25269 tablet_bootstrap.cc:492] T 091552bf73984f8b946031f5bb855ddd P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:38.568125 25269 tablet_bootstrap.cc:654] T 091552bf73984f8b946031f5bb855ddd P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:38.572531 25269 tablet_bootstrap.cc:492] T 091552bf73984f8b946031f5bb855ddd P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:38.572808 25269 ts_tablet_manager.cc:1397] T 091552bf73984f8b946031f5bb855ddd P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.002s
I20260807 18:14:38.573896 25269 raft_consensus.cc:348] T 091552bf73984f8b946031f5bb855ddd P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.574256 25269 raft_consensus.cc:374] T 091552bf73984f8b946031f5bb855ddd P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:38.574414 25269 raft_consensus.cc:729] T 091552bf73984f8b946031f5bb855ddd P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:38.574743 25269 consensus_queue.cc:260] T 091552bf73984f8b946031f5bb855ddd P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.574982 25269 raft_consensus.cc:388] T 091552bf73984f8b946031f5bb855ddd P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:38.575172 25269 raft_consensus.cc:482] T 091552bf73984f8b946031f5bb855ddd P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:38.575297 25269 raft_consensus.cc:3037] T 091552bf73984f8b946031f5bb855ddd P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:38.578549 25269 raft_consensus.cc:504] T 091552bf73984f8b946031f5bb855ddd P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.579249 25269 leader_election.cc:302] T 091552bf73984f8b946031f5bb855ddd P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:38.579555 25269 leader_election.cc:288] T 091552bf73984f8b946031f5bb855ddd P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:38.579605 25276 raft_consensus.cc:2781] T 091552bf73984f8b946031f5bb855ddd P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:38.579357 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.052s user 0.037s sys 0.008s Metrics: {"bytes_written":59432,"cfile_cache_hit":13,"cfile_cache_hit_bytes":46632,"cfile_cache_miss":33,"cfile_cache_miss_bytes":69592,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":1228,"dirs.run_cpu_time_us":1150,"dirs.run_wall_time_us":6705,"drs_written":1,"lbm_read_time_us":2562,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":64,"lbm_write_time_us":1728,"lbm_writes_lt_1ms":29,"mutex_wait_us":166,"num_input_rowsets":2,"peak_mem_usage":34805,"rows_written":247,"spinlock_wait_cycles":18048,"thread_start_us":638,"threads_started":1}
I20260807 18:14:38.579829 25276 raft_consensus.cc:686] T 091552bf73984f8b946031f5bb855ddd P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:38.580084 25276 consensus_queue.cc:237] T 091552bf73984f8b946031f5bb855ddd P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.580303 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10892 bytes on disk
I20260807 18:14:38.580725 25269 ts_tablet_manager.cc:1428] T 091552bf73984f8b946031f5bb855ddd P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260807 18:14:38.581004 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":148,"lbm_reads_lt_1ms":4}
I20260807 18:14:38.581736 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000018
I20260807 18:14:38.593480 24957 catalog_manager.cc:5495] T 091552bf73984f8b946031f5bb855ddd P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:38.604858 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.023s user 0.016s sys 0.004s Metrics: {"bytes_written":334,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":212,"dirs.run_cpu_time_us":183,"dirs.run_wall_time_us":1148,"drs_written":1,"lbm_read_time_us":97,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1036,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":2,"spinlock_wait_cycles":15744,"update_count":1}
I20260807 18:14:38.605000 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000083
I20260807 18:14:38.605881 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 235 bytes on disk
I20260807 18:14:38.606658 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":132,"lbm_reads_lt_1ms":4}
I20260807 18:14:38.607275 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.461964
I20260807 18:14:38.616880 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.009s user 0.005s sys 0.000s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":578,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":86,"lbm_read_time_us":452,"lbm_reads_lt_1ms":21,"lbm_write_time_us":331,"lbm_writes_lt_1ms":9,"reinsert_count":0,"update_count":1}
I20260807 18:14:38.617528 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.012s sys 0.000s Metrics: {"bytes_written":6069,"cfile_init":1,"dirs.queue_time_us":67,"dirs.run_cpu_time_us":225,"dirs.run_wall_time_us":1111,"drs_written":1,"lbm_read_time_us":80,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1078,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:38.617653 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.163231
I20260807 18:14:38.618328 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 548 bytes on disk
I20260807 18:14:38.618958 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":96,"lbm_reads_lt_1ms":4}
I20260807 18:14:38.619632 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.229305
I20260807 18:14:38.648484 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50102:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.124"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:38.654326 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.036s user 0.035s sys 0.000s Metrics: {"bytes_written":59867,"cfile_cache_hit":13,"cfile_cache_hit_bytes":46996,"cfile_cache_miss":33,"cfile_cache_miss_bytes":69912,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":81,"dirs.run_cpu_time_us":270,"dirs.run_wall_time_us":1566,"drs_written":1,"lbm_read_time_us":1558,"lbm_reads_lt_1ms":65,"lbm_write_time_us":1399,"lbm_writes_lt_1ms":29,"num_input_rowsets":2,"peak_mem_usage":35266,"rows_written":249}
I20260807 18:14:38.655213 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10995 bytes on disk
I20260807 18:14:38.655805 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":99,"lbm_reads_lt_1ms":4}
I20260807 18:14:38.656424 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000014
I20260807 18:14:38.659700 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.040s user 0.033s sys 0.003s Metrics: {"bytes_written":59867,"cfile_cache_hit":13,"cfile_cache_hit_bytes":46955,"cfile_cache_miss":33,"cfile_cache_miss_bytes":70107,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":640,"dirs.run_cpu_time_us":983,"dirs.run_wall_time_us":8263,"drs_written":1,"lbm_read_time_us":1615,"lbm_reads_lt_1ms":65,"lbm_write_time_us":1623,"lbm_writes_lt_1ms":29,"mutex_wait_us":171,"num_input_rowsets":2,"peak_mem_usage":35575,"rows_written":249,"spinlock_wait_cycles":3968}
I20260807 18:14:38.661487 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10995 bytes on disk
I20260807 18:14:38.662042 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":86,"lbm_reads_lt_1ms":4}
I20260807 18:14:38.662577 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000012
I20260807 18:14:38.663913 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 4dd0284542a44b999e920686610e0f3d (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.124 [id=8992ed39099f4261a9c9687a6386920a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:38.664477 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dd0284542a44b999e920686610e0f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:38.670230 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.013s user 0.010s sys 0.002s Metrics: {"bytes_written":329,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":381,"dirs.run_cpu_time_us":211,"dirs.run_wall_time_us":1641,"drs_written":1,"lbm_read_time_us":83,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1269,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":2,"spinlock_wait_cycles":66432,"update_count":1}
I20260807 18:14:38.671000 25269 tablet_bootstrap.cc:492] T 4dd0284542a44b999e920686610e0f3d P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:38.671365 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 167 bytes on disk
I20260807 18:14:38.671977 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":85,"lbm_reads_lt_1ms":4}
I20260807 18:14:38.672785 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.539344
I20260807 18:14:38.673642 25269 tablet_bootstrap.cc:654] T 4dd0284542a44b999e920686610e0f3d P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:38.675062 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.010s sys 0.000s Metrics: {"bytes_written":5158,"cfile_init":1,"dirs.queue_time_us":73,"dirs.run_cpu_time_us":265,"dirs.run_wall_time_us":1157,"drs_written":1,"lbm_read_time_us":84,"lbm_reads_lt_1ms":4,"lbm_write_time_us":941,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2,"spinlock_wait_cycles":28544}
I20260807 18:14:38.675895 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 235 bytes on disk
I20260807 18:14:38.676544 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":95,"lbm_reads_lt_1ms":4}
I20260807 18:14:38.677201 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.186525
I20260807 18:14:38.677852 25269 tablet_bootstrap.cc:492] T 4dd0284542a44b999e920686610e0f3d P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:38.678045 25269 ts_tablet_manager.cc:1397] T 4dd0284542a44b999e920686610e0f3d P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260807 18:14:38.680296 25269 raft_consensus.cc:348] T 4dd0284542a44b999e920686610e0f3d P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.680562 25269 raft_consensus.cc:374] T 4dd0284542a44b999e920686610e0f3d P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:38.680728 25269 raft_consensus.cc:729] T 4dd0284542a44b999e920686610e0f3d P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:38.681069 25269 consensus_queue.cc:260] T 4dd0284542a44b999e920686610e0f3d P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.681324 25269 raft_consensus.cc:388] T 4dd0284542a44b999e920686610e0f3d P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:38.681458 25269 raft_consensus.cc:482] T 4dd0284542a44b999e920686610e0f3d P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:38.681633 25269 raft_consensus.cc:3037] T 4dd0284542a44b999e920686610e0f3d P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:38.682987 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.010s user 0.009s sys 0.000s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":460,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":217,"lbm_read_time_us":432,"lbm_reads_lt_1ms":21,"lbm_write_time_us":405,"lbm_writes_lt_1ms":9,"reinsert_count":0,"update_count":1}
I20260807 18:14:38.683622 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.190237
I20260807 18:14:38.684680 25269 raft_consensus.cc:504] T 4dd0284542a44b999e920686610e0f3d P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.685030 25269 leader_election.cc:302] T 4dd0284542a44b999e920686610e0f3d P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:38.685420 25276 raft_consensus.cc:2781] T 4dd0284542a44b999e920686610e0f3d P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:38.685623 25276 raft_consensus.cc:686] T 4dd0284542a44b999e920686610e0f3d P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:38.685978 25276 consensus_queue.cc:237] T 4dd0284542a44b999e920686610e0f3d P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.694679 24957 catalog_manager.cc:5495] T 4dd0284542a44b999e920686610e0f3d P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:38.699527 25269 leader_election.cc:288] T 4dd0284542a44b999e920686610e0f3d P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:38.713521 25269 ts_tablet_manager.cc:1428] T 4dd0284542a44b999e920686610e0f3d P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.035s user 0.000s sys 0.007s
I20260807 18:14:38.717000 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.039s user 0.037s sys 0.000s Metrics: {"bytes_written":333,"cfile_cache_hit":12,"cfile_cache_hit_bytes":47300,"cfile_cache_miss":30,"cfile_cache_miss_bytes":70038,"cfile_init":7,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":628,"dirs.run_cpu_time_us":220,"dirs.run_wall_time_us":1158,"drs_written":1,"lbm_read_time_us":1285,"lbm_reads_lt_1ms":58,"lbm_write_time_us":1609,"lbm_writes_lt_1ms":34,"mutex_wait_us":29,"num_input_rowsets":2,"peak_mem_usage":35532,"reinsert_count":0,"rows_written":251,"spinlock_wait_cycles":9472,"update_count":1}
I20260807 18:14:38.718905 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 11057 bytes on disk
I20260807 18:14:38.719588 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":92,"lbm_reads_lt_1ms":4}
I20260807 18:14:38.720968 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.037s user 0.032s sys 0.003s Metrics: {"bytes_written":333,"cfile_cache_hit":13,"cfile_cache_hit_bytes":47333,"cfile_cache_miss":33,"cfile_cache_miss_bytes":70107,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":6,"dirs.queue_time_us":537,"dirs.run_cpu_time_us":189,"dirs.run_wall_time_us":980,"drs_written":1,"lbm_read_time_us":1547,"lbm_reads_lt_1ms":65,"lbm_write_time_us":1589,"lbm_writes_lt_1ms":34,"mutex_wait_us":44,"num_input_rowsets":2,"peak_mem_usage":35532,"reinsert_count":0,"rows_written":251,"spinlock_wait_cycles":1280,"update_count":1}
I20260807 18:14:38.721971 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 11057 bytes on disk
I20260807 18:14:38.722584 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":117,"lbm_reads_lt_1ms":4}
I20260807 18:14:38.760030 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50114:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.125"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:38.773420 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 840f00cd6bde4bbf96ff682d26207fbb (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.125 [id=1354ddc2d0084264bb43f1ba88a4d25e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:38.774027 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 840f00cd6bde4bbf96ff682d26207fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:38.779769 25269 tablet_bootstrap.cc:492] T 840f00cd6bde4bbf96ff682d26207fbb P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:38.781860 25269 tablet_bootstrap.cc:654] T 840f00cd6bde4bbf96ff682d26207fbb P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:38.785423 25269 tablet_bootstrap.cc:492] T 840f00cd6bde4bbf96ff682d26207fbb P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:38.785651 25269 ts_tablet_manager.cc:1397] T 840f00cd6bde4bbf96ff682d26207fbb P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20260807 18:14:38.786506 25269 raft_consensus.cc:348] T 840f00cd6bde4bbf96ff682d26207fbb P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.786739 25269 raft_consensus.cc:374] T 840f00cd6bde4bbf96ff682d26207fbb P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:38.786881 25269 raft_consensus.cc:729] T 840f00cd6bde4bbf96ff682d26207fbb P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:38.787223 25269 consensus_queue.cc:260] T 840f00cd6bde4bbf96ff682d26207fbb P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.787417 25269 raft_consensus.cc:388] T 840f00cd6bde4bbf96ff682d26207fbb P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:38.787580 25269 raft_consensus.cc:482] T 840f00cd6bde4bbf96ff682d26207fbb P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:38.787748 25269 raft_consensus.cc:3037] T 840f00cd6bde4bbf96ff682d26207fbb P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:38.790653 25269 raft_consensus.cc:504] T 840f00cd6bde4bbf96ff682d26207fbb P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.790961 25269 leader_election.cc:302] T 840f00cd6bde4bbf96ff682d26207fbb P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:38.791237 25269 leader_election.cc:288] T 840f00cd6bde4bbf96ff682d26207fbb P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:38.791285 25276 raft_consensus.cc:2781] T 840f00cd6bde4bbf96ff682d26207fbb P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:38.791508 25276 raft_consensus.cc:686] T 840f00cd6bde4bbf96ff682d26207fbb P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:38.791798 25269 ts_tablet_manager.cc:1428] T 840f00cd6bde4bbf96ff682d26207fbb P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.003s sys 0.001s
I20260807 18:14:38.791795 25276 consensus_queue.cc:237] T 840f00cd6bde4bbf96ff682d26207fbb P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.799013 24957 catalog_manager.cc:5495] T 840f00cd6bde4bbf96ff682d26207fbb P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:38.842195 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50120:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.126"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:38.855532 25147 tablet_service.cc:1467] Processing CreateTablet for tablet eeae4ee4f9124fc295f05f6572c85f41 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.126 [id=30cb738f89304f168f2951d01e19fdc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:38.856228 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeae4ee4f9124fc295f05f6572c85f41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:38.862684 25269 tablet_bootstrap.cc:492] T eeae4ee4f9124fc295f05f6572c85f41 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:38.865556 25269 tablet_bootstrap.cc:654] T eeae4ee4f9124fc295f05f6572c85f41 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:38.868839 25269 tablet_bootstrap.cc:492] T eeae4ee4f9124fc295f05f6572c85f41 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:38.869042 25269 ts_tablet_manager.cc:1397] T eeae4ee4f9124fc295f05f6572c85f41 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260807 18:14:38.870033 25269 raft_consensus.cc:348] T eeae4ee4f9124fc295f05f6572c85f41 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.870291 25269 raft_consensus.cc:374] T eeae4ee4f9124fc295f05f6572c85f41 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:38.870433 25269 raft_consensus.cc:729] T eeae4ee4f9124fc295f05f6572c85f41 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:38.870690 25269 consensus_queue.cc:260] T eeae4ee4f9124fc295f05f6572c85f41 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.870978 25269 raft_consensus.cc:388] T eeae4ee4f9124fc295f05f6572c85f41 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:38.871100 25269 raft_consensus.cc:482] T eeae4ee4f9124fc295f05f6572c85f41 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:38.871263 25269 raft_consensus.cc:3037] T eeae4ee4f9124fc295f05f6572c85f41 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:38.873209 25269 raft_consensus.cc:504] T eeae4ee4f9124fc295f05f6572c85f41 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.873623 25269 leader_election.cc:302] T eeae4ee4f9124fc295f05f6572c85f41 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:38.874030 25269 leader_election.cc:288] T eeae4ee4f9124fc295f05f6572c85f41 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:38.874076 25276 raft_consensus.cc:2781] T eeae4ee4f9124fc295f05f6572c85f41 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:38.874217 25276 raft_consensus.cc:686] T eeae4ee4f9124fc295f05f6572c85f41 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:38.874465 25276 consensus_queue.cc:237] T eeae4ee4f9124fc295f05f6572c85f41 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.875607 25269 ts_tablet_manager.cc:1428] T eeae4ee4f9124fc295f05f6572c85f41 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260807 18:14:38.884346 24957 catalog_manager.cc:5495] T eeae4ee4f9124fc295f05f6572c85f41 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:38.938683 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50124:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.127"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:38.951967 25147 tablet_service.cc:1467] Processing CreateTablet for tablet c64dd2f8ce264fee8f1106570ac61212 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.127 [id=a21b9dca6b1247a29898f96b7b85285b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:38.952585 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c64dd2f8ce264fee8f1106570ac61212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:38.958902 25269 tablet_bootstrap.cc:492] T c64dd2f8ce264fee8f1106570ac61212 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:38.961380 25269 tablet_bootstrap.cc:654] T c64dd2f8ce264fee8f1106570ac61212 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:38.965401 25269 tablet_bootstrap.cc:492] T c64dd2f8ce264fee8f1106570ac61212 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:38.965636 25269 ts_tablet_manager.cc:1397] T c64dd2f8ce264fee8f1106570ac61212 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260807 18:14:38.966743 25269 raft_consensus.cc:348] T c64dd2f8ce264fee8f1106570ac61212 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.967118 25269 raft_consensus.cc:374] T c64dd2f8ce264fee8f1106570ac61212 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:38.967298 25269 raft_consensus.cc:729] T c64dd2f8ce264fee8f1106570ac61212 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:38.967696 25269 consensus_queue.cc:260] T c64dd2f8ce264fee8f1106570ac61212 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.967971 25269 raft_consensus.cc:388] T c64dd2f8ce264fee8f1106570ac61212 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:38.968186 25269 raft_consensus.cc:482] T c64dd2f8ce264fee8f1106570ac61212 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:38.968437 25269 raft_consensus.cc:3037] T c64dd2f8ce264fee8f1106570ac61212 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:38.970527 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000082
I20260807 18:14:38.972975 25269 raft_consensus.cc:504] T c64dd2f8ce264fee8f1106570ac61212 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.973389 25269 leader_election.cc:302] T c64dd2f8ce264fee8f1106570ac61212 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:38.973814 25269 leader_election.cc:288] T c64dd2f8ce264fee8f1106570ac61212 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:38.973876 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000084
I20260807 18:14:38.975180 25275 raft_consensus.cc:2781] T c64dd2f8ce264fee8f1106570ac61212 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:38.975449 25275 raft_consensus.cc:686] T c64dd2f8ce264fee8f1106570ac61212 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:38.975744 25269 ts_tablet_manager.cc:1428] T c64dd2f8ce264fee8f1106570ac61212 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.010s user 0.002s sys 0.005s
I20260807 18:14:38.975813 25275 consensus_queue.cc:237] T c64dd2f8ce264fee8f1106570ac61212 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:38.986799 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.016s user 0.007s sys 0.007s Metrics: {"bytes_written":6032,"cfile_init":1,"dirs.queue_time_us":59,"dirs.run_cpu_time_us":175,"dirs.run_wall_time_us":1299,"drs_written":1,"lbm_read_time_us":100,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1580,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:38.987749 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.232958
I20260807 18:14:38.987962 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.014s user 0.007s sys 0.004s Metrics: {"bytes_written":6032,"cfile_init":1,"dirs.queue_time_us":69,"dirs.run_cpu_time_us":148,"dirs.run_wall_time_us":927,"drs_written":1,"lbm_read_time_us":102,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1262,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:38.988909 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.232958
I20260807 18:14:39.001065 24957 catalog_manager.cc:5495] T c64dd2f8ce264fee8f1106570ac61212 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:39.034169 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.045s user 0.027s sys 0.015s Metrics: {"bytes_written":336,"cfile_cache_hit":13,"cfile_cache_hit_bytes":48398,"cfile_cache_miss":33,"cfile_cache_miss_bytes":72236,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":6,"dirs.queue_time_us":540,"dirs.run_cpu_time_us":209,"dirs.run_wall_time_us":1240,"drs_written":1,"lbm_read_time_us":1455,"lbm_reads_lt_1ms":65,"lbm_write_time_us":1822,"lbm_writes_lt_1ms":34,"num_input_rowsets":2,"peak_mem_usage":36645,"reinsert_count":0,"rows_written":257,"update_count":1}
I20260807 18:14:39.035013 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 11345 bytes on disk
I20260807 18:14:39.035662 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":88,"lbm_reads_lt_1ms":4}
I20260807 18:14:39.060604 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.073s user 0.039s sys 0.000s Metrics: {"bytes_written":336,"cfile_cache_hit":13,"cfile_cache_hit_bytes":48398,"cfile_cache_miss":33,"cfile_cache_miss_bytes":72236,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":6,"dirs.queue_time_us":978,"dirs.run_cpu_time_us":835,"dirs.run_wall_time_us":4307,"drs_written":1,"lbm_read_time_us":4328,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":64,"lbm_write_time_us":1388,"lbm_writes_lt_1ms":34,"mutex_wait_us":954,"num_input_rowsets":2,"peak_mem_usage":36645,"reinsert_count":0,"rows_written":257,"spinlock_wait_cycles":15872,"update_count":1}
I20260807 18:14:39.061841 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 11345 bytes on disk
I20260807 18:14:39.062502 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":64,"lbm_reads_lt_1ms":4}
I20260807 18:14:39.072995 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50128:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.128"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:39.087692 25147 tablet_service.cc:1467] Processing CreateTablet for tablet bcfeb070602e43dabaf4c91e33501c5c (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.128 [id=515bbb4d8ac84c4f978c5a5bea662804]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:39.088662 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcfeb070602e43dabaf4c91e33501c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:39.097136 25269 tablet_bootstrap.cc:492] T bcfeb070602e43dabaf4c91e33501c5c P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:39.099598 25269 tablet_bootstrap.cc:654] T bcfeb070602e43dabaf4c91e33501c5c P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:39.103385 25269 tablet_bootstrap.cc:492] T bcfeb070602e43dabaf4c91e33501c5c P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:39.103719 25269 ts_tablet_manager.cc:1397] T bcfeb070602e43dabaf4c91e33501c5c P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 18:14:39.105201 25269 raft_consensus.cc:348] T bcfeb070602e43dabaf4c91e33501c5c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.105589 25269 raft_consensus.cc:374] T bcfeb070602e43dabaf4c91e33501c5c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:39.105834 25269 raft_consensus.cc:729] T bcfeb070602e43dabaf4c91e33501c5c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:39.106158 25269 consensus_queue.cc:260] T bcfeb070602e43dabaf4c91e33501c5c P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.106482 25269 raft_consensus.cc:388] T bcfeb070602e43dabaf4c91e33501c5c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:39.106634 25269 raft_consensus.cc:482] T bcfeb070602e43dabaf4c91e33501c5c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:39.106791 25269 raft_consensus.cc:3037] T bcfeb070602e43dabaf4c91e33501c5c P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:39.109272 25269 raft_consensus.cc:504] T bcfeb070602e43dabaf4c91e33501c5c P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.109701 25269 leader_election.cc:302] T bcfeb070602e43dabaf4c91e33501c5c P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:39.109982 25269 leader_election.cc:288] T bcfeb070602e43dabaf4c91e33501c5c P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:39.110045 25275 raft_consensus.cc:2781] T bcfeb070602e43dabaf4c91e33501c5c P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:39.110357 25275 raft_consensus.cc:686] T bcfeb070602e43dabaf4c91e33501c5c P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:39.110622 25275 consensus_queue.cc:237] T bcfeb070602e43dabaf4c91e33501c5c P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.110771 25269 ts_tablet_manager.cc:1428] T bcfeb070602e43dabaf4c91e33501c5c P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.000s sys 0.008s
I20260807 18:14:39.118640 24956 catalog_manager.cc:5495] T bcfeb070602e43dabaf4c91e33501c5c P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:39.161055 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50136:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.129"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:39.174803 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 52afea6c1b3542eaa5a7e007b0c55943 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.129 [id=05fdbedf3c27486d988e7faf154d0cbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:39.175405 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52afea6c1b3542eaa5a7e007b0c55943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:39.182164 25269 tablet_bootstrap.cc:492] T 52afea6c1b3542eaa5a7e007b0c55943 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:39.184173 25269 tablet_bootstrap.cc:654] T 52afea6c1b3542eaa5a7e007b0c55943 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:39.188108 25269 tablet_bootstrap.cc:492] T 52afea6c1b3542eaa5a7e007b0c55943 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:39.188297 25269 ts_tablet_manager.cc:1397] T 52afea6c1b3542eaa5a7e007b0c55943 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 18:14:39.189132 25269 raft_consensus.cc:348] T 52afea6c1b3542eaa5a7e007b0c55943 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.189499 25269 raft_consensus.cc:374] T 52afea6c1b3542eaa5a7e007b0c55943 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:39.189628 25269 raft_consensus.cc:729] T 52afea6c1b3542eaa5a7e007b0c55943 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:39.189953 25269 consensus_queue.cc:260] T 52afea6c1b3542eaa5a7e007b0c55943 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.190130 25269 raft_consensus.cc:388] T 52afea6c1b3542eaa5a7e007b0c55943 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:39.190253 25269 raft_consensus.cc:482] T 52afea6c1b3542eaa5a7e007b0c55943 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:39.190378 25269 raft_consensus.cc:3037] T 52afea6c1b3542eaa5a7e007b0c55943 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:39.193610 25269 raft_consensus.cc:504] T 52afea6c1b3542eaa5a7e007b0c55943 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.194125 25269 leader_election.cc:302] T 52afea6c1b3542eaa5a7e007b0c55943 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:39.194622 25269 leader_election.cc:288] T 52afea6c1b3542eaa5a7e007b0c55943 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:39.194700 25275 raft_consensus.cc:2781] T 52afea6c1b3542eaa5a7e007b0c55943 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:39.194934 25275 raft_consensus.cc:686] T 52afea6c1b3542eaa5a7e007b0c55943 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:39.195268 25275 consensus_queue.cc:237] T 52afea6c1b3542eaa5a7e007b0c55943 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.195365 25269 ts_tablet_manager.cc:1428] T 52afea6c1b3542eaa5a7e007b0c55943 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260807 18:14:39.204010 24956 catalog_manager.cc:5495] T 52afea6c1b3542eaa5a7e007b0c55943 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:39.243121 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50152:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.130"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:39.255424 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 9b804663537447928e620d3ec44534ae (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.130 [id=1b221c90fc2a42fc8d4d235776592c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:39.256019 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b804663537447928e620d3ec44534ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:39.262465 25269 tablet_bootstrap.cc:492] T 9b804663537447928e620d3ec44534ae P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:39.264791 25269 tablet_bootstrap.cc:654] T 9b804663537447928e620d3ec44534ae P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:39.269622 25269 tablet_bootstrap.cc:492] T 9b804663537447928e620d3ec44534ae P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:39.269845 25269 ts_tablet_manager.cc:1397] T 9b804663537447928e620d3ec44534ae P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.001s
I20260807 18:14:39.271057 25269 raft_consensus.cc:348] T 9b804663537447928e620d3ec44534ae P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.271360 25269 raft_consensus.cc:374] T 9b804663537447928e620d3ec44534ae P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:39.271620 25269 raft_consensus.cc:729] T 9b804663537447928e620d3ec44534ae P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:39.272030 25269 consensus_queue.cc:260] T 9b804663537447928e620d3ec44534ae P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.272418 25269 raft_consensus.cc:388] T 9b804663537447928e620d3ec44534ae P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:39.272603 25269 raft_consensus.cc:482] T 9b804663537447928e620d3ec44534ae P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:39.272879 25269 raft_consensus.cc:3037] T 9b804663537447928e620d3ec44534ae P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:39.276054 25269 raft_consensus.cc:504] T 9b804663537447928e620d3ec44534ae P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.276453 25269 leader_election.cc:302] T 9b804663537447928e620d3ec44534ae P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:39.276717 25269 leader_election.cc:288] T 9b804663537447928e620d3ec44534ae P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:39.276929 25275 raft_consensus.cc:2781] T 9b804663537447928e620d3ec44534ae P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:39.277220 25275 raft_consensus.cc:686] T 9b804663537447928e620d3ec44534ae P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:39.277607 25269 ts_tablet_manager.cc:1428] T 9b804663537447928e620d3ec44534ae P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.006s sys 0.002s
I20260807 18:14:39.277724 25275 consensus_queue.cc:237] T 9b804663537447928e620d3ec44534ae P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.286751 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000083
I20260807 18:14:39.288187 24956 catalog_manager.cc:5495] T 9b804663537447928e620d3ec44534ae P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:39.313613 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000091
I20260807 18:14:39.315100 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.027s user 0.013s sys 0.002s Metrics: {"bytes_written":336,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":70,"dirs.run_cpu_time_us":205,"dirs.run_wall_time_us":2977,"drs_written":1,"lbm_read_time_us":122,"lbm_reads_lt_1ms":4,"lbm_write_time_us":8958,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":30,"peak_mem_usage":0,"reinsert_count":0,"rows_written":6,"update_count":1}
I20260807 18:14:39.316166 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 509 bytes on disk
I20260807 18:14:39.317004 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":121,"lbm_reads_lt_1ms":4}
I20260807 18:14:39.317826 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.236367
I20260807 18:14:39.339071 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.025s user 0.018s sys 0.005s Metrics: {"bytes_written":6069,"cfile_init":1,"dirs.queue_time_us":79,"dirs.run_cpu_time_us":217,"dirs.run_wall_time_us":1352,"drs_written":1,"lbm_read_time_us":132,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1665,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:39.340584 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.231763
I20260807 18:14:39.377204 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.059s user 0.052s sys 0.004s Metrics: {"bytes_written":62953,"cfile_cache_hit":14,"cfile_cache_hit_bytes":49547,"cfile_cache_miss":36,"cfile_cache_miss_bytes":74361,"cfile_init":9,"delta_iterators_relevant":8,"dirs.queue_time_us":1576,"dirs.run_cpu_time_us":731,"dirs.run_wall_time_us":4475,"drs_written":1,"lbm_read_time_us":1911,"lbm_reads_lt_1ms":72,"lbm_write_time_us":2108,"lbm_writes_lt_1ms":30,"mutex_wait_us":180,"num_input_rowsets":2,"peak_mem_usage":37864,"rows_written":263,"thread_start_us":741,"threads_started":1}
I20260807 18:14:39.378630 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 11583 bytes on disk
I20260807 18:14:39.379495 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":77,"lbm_reads_lt_1ms":4}
I20260807 18:14:39.380554 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50166:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.131"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:39.394176 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 8736f5d174bf4125916de7c640f24376 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.131 [id=a2c789795a5d4990bfb323bfb9ce81ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:39.394733 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8736f5d174bf4125916de7c640f24376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:39.399398 25269 tablet_bootstrap.cc:492] T 8736f5d174bf4125916de7c640f24376 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:39.402244 25269 tablet_bootstrap.cc:654] T 8736f5d174bf4125916de7c640f24376 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:39.406311 25269 tablet_bootstrap.cc:492] T 8736f5d174bf4125916de7c640f24376 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:39.406672 25269 ts_tablet_manager.cc:1397] T 8736f5d174bf4125916de7c640f24376 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 18:14:39.408018 25269 raft_consensus.cc:348] T 8736f5d174bf4125916de7c640f24376 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.408327 25269 raft_consensus.cc:374] T 8736f5d174bf4125916de7c640f24376 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:39.408474 25269 raft_consensus.cc:729] T 8736f5d174bf4125916de7c640f24376 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:39.409065 25269 consensus_queue.cc:260] T 8736f5d174bf4125916de7c640f24376 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.409368 25269 raft_consensus.cc:388] T 8736f5d174bf4125916de7c640f24376 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:39.409627 25269 raft_consensus.cc:482] T 8736f5d174bf4125916de7c640f24376 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:39.409922 25269 raft_consensus.cc:3037] T 8736f5d174bf4125916de7c640f24376 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:39.411665 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.071s user 0.056s sys 0.006s Metrics: {"bytes_written":62953,"cfile_cache_hit":13,"cfile_cache_hit_bytes":49550,"cfile_cache_miss":33,"cfile_cache_miss_bytes":73984,"cfile_init":9,"delta_iterators_relevant":6,"dirs.queue_time_us":1648,"dirs.run_cpu_time_us":891,"dirs.run_wall_time_us":4927,"drs_written":1,"lbm_read_time_us":2555,"lbm_reads_lt_1ms":69,"lbm_write_time_us":2198,"lbm_writes_lt_1ms":30,"mutex_wait_us":3,"num_input_rowsets":2,"peak_mem_usage":37811,"rows_written":263,"spinlock_wait_cycles":4224,"thread_start_us":952,"threads_started":1}
I20260807 18:14:39.412844 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 11583 bytes on disk
I20260807 18:14:39.413553 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":112,"lbm_reads_lt_1ms":4}
I20260807 18:14:39.414011 25269 raft_consensus.cc:504] T 8736f5d174bf4125916de7c640f24376 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.414119 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000021
I20260807 18:14:39.414368 25269 leader_election.cc:302] T 8736f5d174bf4125916de7c640f24376 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:39.414790 25269 leader_election.cc:288] T 8736f5d174bf4125916de7c640f24376 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:39.414857 25275 raft_consensus.cc:2781] T 8736f5d174bf4125916de7c640f24376 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:39.415107 25275 raft_consensus.cc:686] T 8736f5d174bf4125916de7c640f24376 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:39.415709 25269 ts_tablet_manager.cc:1428] T 8736f5d174bf4125916de7c640f24376 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.009s user 0.005s sys 0.004s
I20260807 18:14:39.415683 25275 consensus_queue.cc:237] T 8736f5d174bf4125916de7c640f24376 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.423215 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.009s user 0.007s sys 0.000s Metrics: {"bytes_written":5158,"cfile_init":1,"dirs.queue_time_us":57,"dirs.run_cpu_time_us":145,"dirs.run_wall_time_us":1032,"drs_written":1,"lbm_read_time_us":47,"lbm_reads_lt_1ms":4,"lbm_write_time_us":832,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:39.424067 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.162802
I20260807 18:14:39.434794 24956 catalog_manager.cc:5495] T 8736f5d174bf4125916de7c640f24376 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:39.464375 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.040s user 0.038s sys 0.000s Metrics: {"bytes_written":336,"cfile_cache_hit":12,"cfile_cache_hit_bytes":49886,"cfile_cache_miss":30,"cfile_cache_miss_bytes":73826,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":1378,"dirs.run_cpu_time_us":1038,"dirs.run_wall_time_us":5156,"drs_written":1,"lbm_read_time_us":1376,"lbm_reads_lt_1ms":62,"lbm_write_time_us":1953,"lbm_writes_lt_1ms":34,"mutex_wait_us":280,"num_input_rowsets":2,"peak_mem_usage":37773,"reinsert_count":0,"rows_written":265,"spinlock_wait_cycles":17152,"thread_start_us":704,"threads_started":1,"update_count":1}
I20260807 18:14:39.465397 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 11694 bytes on disk
I20260807 18:14:39.466627 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":106,"lbm_reads_lt_1ms":4}
I20260807 18:14:39.478122 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50170:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.132"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:39.491338 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 2cfadee2394146abad5593a7f424ede5 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.132 [id=51185a57924c47c08c12388069a4c352]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:39.491815 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cfadee2394146abad5593a7f424ede5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:39.498421 25269 tablet_bootstrap.cc:492] T 2cfadee2394146abad5593a7f424ede5 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:39.501004 25269 tablet_bootstrap.cc:654] T 2cfadee2394146abad5593a7f424ede5 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:39.505694 25269 tablet_bootstrap.cc:492] T 2cfadee2394146abad5593a7f424ede5 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:39.505901 25269 ts_tablet_manager.cc:1397] T 2cfadee2394146abad5593a7f424ede5 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.005s
I20260807 18:14:39.507346 25269 raft_consensus.cc:348] T 2cfadee2394146abad5593a7f424ede5 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.507682 25269 raft_consensus.cc:374] T 2cfadee2394146abad5593a7f424ede5 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:39.507925 25269 raft_consensus.cc:729] T 2cfadee2394146abad5593a7f424ede5 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:39.508335 25269 consensus_queue.cc:260] T 2cfadee2394146abad5593a7f424ede5 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.508627 25269 raft_consensus.cc:388] T 2cfadee2394146abad5593a7f424ede5 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:39.508782 25269 raft_consensus.cc:482] T 2cfadee2394146abad5593a7f424ede5 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:39.508956 25269 raft_consensus.cc:3037] T 2cfadee2394146abad5593a7f424ede5 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:39.511643 25269 raft_consensus.cc:504] T 2cfadee2394146abad5593a7f424ede5 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.512055 25269 leader_election.cc:302] T 2cfadee2394146abad5593a7f424ede5 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:39.512290 25269 leader_election.cc:288] T 2cfadee2394146abad5593a7f424ede5 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:39.512490 25275 raft_consensus.cc:2781] T 2cfadee2394146abad5593a7f424ede5 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:39.512869 25275 raft_consensus.cc:686] T 2cfadee2394146abad5593a7f424ede5 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:39.513069 25269 ts_tablet_manager.cc:1428] T 2cfadee2394146abad5593a7f424ede5 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.001s sys 0.003s
I20260807 18:14:39.513247 25275 consensus_queue.cc:237] T 2cfadee2394146abad5593a7f424ede5 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.522639 24956 catalog_manager.cc:5495] T 2cfadee2394146abad5593a7f424ede5 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:39.569873 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50178:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.133"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:39.582538 25147 tablet_service.cc:1467] Processing CreateTablet for tablet c8f4134496c9423596717207158cbaab (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.133 [id=14e898b206e443e9ba0fcfd38edfd080]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:39.583264 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8f4134496c9423596717207158cbaab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:39.590591 25269 tablet_bootstrap.cc:492] T c8f4134496c9423596717207158cbaab P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:39.593016 25269 tablet_bootstrap.cc:654] T c8f4134496c9423596717207158cbaab P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:39.597641 25269 tablet_bootstrap.cc:492] T c8f4134496c9423596717207158cbaab P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:39.597963 25269 ts_tablet_manager.cc:1397] T c8f4134496c9423596717207158cbaab P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.005s
I20260807 18:14:39.599345 25269 raft_consensus.cc:348] T c8f4134496c9423596717207158cbaab P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.599705 25269 raft_consensus.cc:374] T c8f4134496c9423596717207158cbaab P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:39.599815 25269 raft_consensus.cc:729] T c8f4134496c9423596717207158cbaab P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:39.600167 25269 consensus_queue.cc:260] T c8f4134496c9423596717207158cbaab P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.600394 25269 raft_consensus.cc:388] T c8f4134496c9423596717207158cbaab P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:39.600574 25269 raft_consensus.cc:482] T c8f4134496c9423596717207158cbaab P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:39.600765 25269 raft_consensus.cc:3037] T c8f4134496c9423596717207158cbaab P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:39.603542 25269 raft_consensus.cc:504] T c8f4134496c9423596717207158cbaab P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.603927 25269 leader_election.cc:302] T c8f4134496c9423596717207158cbaab P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:39.604328 25269 leader_election.cc:288] T c8f4134496c9423596717207158cbaab P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:39.604384 25275 raft_consensus.cc:2781] T c8f4134496c9423596717207158cbaab P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:39.604642 25275 raft_consensus.cc:686] T c8f4134496c9423596717207158cbaab P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:39.605119 25269 ts_tablet_manager.cc:1428] T c8f4134496c9423596717207158cbaab P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260807 18:14:39.605057 25275 consensus_queue.cc:237] T c8f4134496c9423596717207158cbaab P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.612295 24956 catalog_manager.cc:5495] T c8f4134496c9423596717207158cbaab P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:39.630716 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000088
I20260807 18:14:39.656162 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.025s user 0.015s sys 0.007s Metrics: {"bytes_written":6069,"cfile_init":1,"dirs.queue_time_us":86,"dirs.run_cpu_time_us":256,"dirs.run_wall_time_us":1404,"drs_written":1,"lbm_read_time_us":101,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1292,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:39.657363 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.231287
I20260807 18:14:39.661839 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50188:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.134"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:39.676163 25147 tablet_service.cc:1467] Processing CreateTablet for tablet cedc32f55bed463b81e2298ddb913d48 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.134 [id=fd06aa96fb9f4ca88cb0295cd709b803]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:39.676776 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cedc32f55bed463b81e2298ddb913d48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:39.685016 25269 tablet_bootstrap.cc:492] T cedc32f55bed463b81e2298ddb913d48 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:39.687279 25269 tablet_bootstrap.cc:654] T cedc32f55bed463b81e2298ddb913d48 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:39.688529 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.031s user 0.030s sys 0.001s Metrics: {"bytes_written":64258,"cfile_cache_hit":12,"cfile_cache_hit_bytes":50659,"cfile_cache_miss":30,"cfile_cache_miss_bytes":75161,"cfile_init":8,"delta_iterators_relevant":4,"dirs.queue_time_us":698,"dirs.run_cpu_time_us":238,"dirs.run_wall_time_us":1351,"drs_written":1,"lbm_read_time_us":1317,"lbm_reads_lt_1ms":62,"lbm_write_time_us":1114,"lbm_writes_lt_1ms":30,"mutex_wait_us":151,"num_input_rowsets":2,"peak_mem_usage":38545,"rows_written":269,"spinlock_wait_cycles":1920}
I20260807 18:14:39.689574 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000009
I20260807 18:14:39.692094 25269 tablet_bootstrap.cc:492] T cedc32f55bed463b81e2298ddb913d48 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:39.692252 25269 ts_tablet_manager.cc:1397] T cedc32f55bed463b81e2298ddb913d48 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260807 18:14:39.693239 25269 raft_consensus.cc:348] T cedc32f55bed463b81e2298ddb913d48 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.693575 25269 raft_consensus.cc:374] T cedc32f55bed463b81e2298ddb913d48 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:39.693827 25269 raft_consensus.cc:729] T cedc32f55bed463b81e2298ddb913d48 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:39.694267 25269 consensus_queue.cc:260] T cedc32f55bed463b81e2298ddb913d48 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.694670 25269 raft_consensus.cc:388] T cedc32f55bed463b81e2298ddb913d48 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:39.694844 25269 raft_consensus.cc:482] T cedc32f55bed463b81e2298ddb913d48 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:39.695118 25269 raft_consensus.cc:3037] T cedc32f55bed463b81e2298ddb913d48 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:39.697981 25269 raft_consensus.cc:504] T cedc32f55bed463b81e2298ddb913d48 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.698045 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.008s user 0.007s sys 0.000s Metrics: {"bytes_written":5158,"cfile_init":1,"dirs.queue_time_us":86,"dirs.run_cpu_time_us":158,"dirs.run_wall_time_us":1064,"drs_written":1,"lbm_read_time_us":102,"lbm_reads_lt_1ms":4,"lbm_write_time_us":628,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2,"spinlock_wait_cycles":27264}
I20260807 18:14:39.698436 25269 leader_election.cc:302] T cedc32f55bed463b81e2298ddb913d48 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:39.698745 25269 leader_election.cc:288] T cedc32f55bed463b81e2298ddb913d48 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:39.698846 25275 raft_consensus.cc:2781] T cedc32f55bed463b81e2298ddb913d48 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:39.699019 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 12092 bytes on disk
I20260807 18:14:39.699213 25275 raft_consensus.cc:686] T cedc32f55bed463b81e2298ddb913d48 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:39.699580 25269 ts_tablet_manager.cc:1428] T cedc32f55bed463b81e2298ddb913d48 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260807 18:14:39.699594 25275 consensus_queue.cc:237] T cedc32f55bed463b81e2298ddb913d48 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.700449 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":279,"lbm_reads_lt_1ms":8}
I20260807 18:14:39.701719 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.186134
I20260807 18:14:39.710865 24956 catalog_manager.cc:5495] T cedc32f55bed463b81e2298ddb913d48 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:39.717661 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000082
I20260807 18:14:39.730803 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.013s user 0.011s sys 0.000s Metrics: {"bytes_written":6068,"cfile_init":1,"dirs.queue_time_us":83,"dirs.run_cpu_time_us":194,"dirs.run_wall_time_us":1238,"drs_written":1,"lbm_read_time_us":82,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1128,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:39.731745 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.231093
I20260807 18:14:39.743763 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.038s user 0.026s sys 0.008s Metrics: {"bytes_written":338,"cfile_cache_hit":12,"cfile_cache_hit_bytes":51001,"cfile_cache_miss":30,"cfile_cache_miss_bytes":75473,"cfile_init":7,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":767,"dirs.run_cpu_time_us":236,"dirs.run_wall_time_us":1115,"drs_written":1,"lbm_read_time_us":1185,"lbm_reads_lt_1ms":58,"lbm_write_time_us":1772,"lbm_writes_lt_1ms":34,"mutex_wait_us":166,"num_input_rowsets":2,"peak_mem_usage":38649,"reinsert_count":0,"rows_written":271,"update_count":1}
I20260807 18:14:39.744735 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 11957 bytes on disk
I20260807 18:14:39.745512 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":128,"lbm_reads_lt_1ms":4}
I20260807 18:14:39.764146 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50200:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.135"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:39.769861 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.038s user 0.033s sys 0.003s Metrics: {"bytes_written":64690,"cfile_cache_hit":13,"cfile_cache_hit_bytes":51031,"cfile_cache_miss":33,"cfile_cache_miss_bytes":76149,"cfile_init":9,"delta_iterators_relevant":6,"dirs.queue_time_us":1540,"dirs.run_cpu_time_us":715,"dirs.run_wall_time_us":3283,"drs_written":1,"lbm_read_time_us":1494,"lbm_reads_lt_1ms":69,"lbm_write_time_us":1770,"lbm_writes_lt_1ms":30,"num_input_rowsets":2,"peak_mem_usage":38858,"rows_written":271,"thread_start_us":622,"threads_started":1}
I20260807 18:14:39.770704 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000011
I20260807 18:14:39.777654 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 585383cd782e40f2834f839912ab3f63 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.135 [id=e87633604a9f45c1bbaa280847c0d22a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:39.778210 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 585383cd782e40f2834f839912ab3f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:39.785615 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.015s user 0.014s sys 0.000s Metrics: {"bytes_written":329,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":42,"dirs.run_cpu_time_us":219,"dirs.run_wall_time_us":1179,"drs_written":1,"lbm_read_time_us":80,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1240,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":2,"update_count":1}
I20260807 18:14:39.786692 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 12107 bytes on disk
I20260807 18:14:39.787338 25269 tablet_bootstrap.cc:492] T 585383cd782e40f2834f839912ab3f63 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:39.787670 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":189,"lbm_reads_lt_1ms":8}
I20260807 18:14:39.788298 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.539344
I20260807 18:14:39.790418 25269 tablet_bootstrap.cc:654] T 585383cd782e40f2834f839912ab3f63 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:39.794724 25269 tablet_bootstrap.cc:492] T 585383cd782e40f2834f839912ab3f63 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:39.795045 25269 ts_tablet_manager.cc:1397] T 585383cd782e40f2834f839912ab3f63 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.005s
I20260807 18:14:39.796124 25269 raft_consensus.cc:348] T 585383cd782e40f2834f839912ab3f63 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.796519 25269 raft_consensus.cc:374] T 585383cd782e40f2834f839912ab3f63 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:39.796715 25269 raft_consensus.cc:729] T 585383cd782e40f2834f839912ab3f63 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:39.797130 25269 consensus_queue.cc:260] T 585383cd782e40f2834f839912ab3f63 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.797492 25269 raft_consensus.cc:388] T 585383cd782e40f2834f839912ab3f63 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:39.797736 25269 raft_consensus.cc:482] T 585383cd782e40f2834f839912ab3f63 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:39.797928 25269 raft_consensus.cc:3037] T 585383cd782e40f2834f839912ab3f63 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:39.798034 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.009s user 0.009s sys 0.000s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":460,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":122,"lbm_read_time_us":481,"lbm_reads_lt_1ms":21,"lbm_write_time_us":418,"lbm_writes_lt_1ms":9,"mutex_wait_us":20,"reinsert_count":0,"spinlock_wait_cycles":2304,"update_count":1}
I20260807 18:14:39.798712 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.161632
I20260807 18:14:39.800748 25269 raft_consensus.cc:504] T 585383cd782e40f2834f839912ab3f63 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.801208 25269 leader_election.cc:302] T 585383cd782e40f2834f839912ab3f63 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:39.801584 25269 leader_election.cc:288] T 585383cd782e40f2834f839912ab3f63 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:39.801649 25275 raft_consensus.cc:2781] T 585383cd782e40f2834f839912ab3f63 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:39.801890 25275 raft_consensus.cc:686] T 585383cd782e40f2834f839912ab3f63 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:39.802181 25275 consensus_queue.cc:237] T 585383cd782e40f2834f839912ab3f63 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.802345 25269 ts_tablet_manager.cc:1428] T 585383cd782e40f2834f839912ab3f63 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260807 18:14:39.811270 24956 catalog_manager.cc:5495] T 585383cd782e40f2834f839912ab3f63 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:39.843235 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.044s user 0.039s sys 0.004s Metrics: {"bytes_written":336,"cfile_cache_hit":13,"cfile_cache_hit_bytes":51399,"cfile_cache_miss":33,"cfile_cache_miss_bytes":76073,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":6,"dirs.queue_time_us":1596,"dirs.run_cpu_time_us":959,"dirs.run_wall_time_us":5082,"drs_written":1,"lbm_read_time_us":1521,"lbm_reads_lt_1ms":65,"lbm_write_time_us":1775,"lbm_writes_lt_1ms":34,"mutex_wait_us":109,"num_input_rowsets":2,"peak_mem_usage":38816,"reinsert_count":0,"rows_written":273,"spinlock_wait_cycles":20480,"thread_start_us":281,"threads_started":1,"update_count":1}
I20260807 18:14:39.844235 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 12040 bytes on disk
I20260807 18:14:39.844995 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":126,"lbm_reads_lt_1ms":4}
I20260807 18:14:39.853331 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50206:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.136"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:39.867807 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 7056b75012484d7fb7aa1ed31a4ebbd9 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.136 [id=9ebf5fee65584b48bb16ba09d26f184f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:39.868496 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7056b75012484d7fb7aa1ed31a4ebbd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:39.875295 25269 tablet_bootstrap.cc:492] T 7056b75012484d7fb7aa1ed31a4ebbd9 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:39.877255 25269 tablet_bootstrap.cc:654] T 7056b75012484d7fb7aa1ed31a4ebbd9 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:39.881016 25269 tablet_bootstrap.cc:492] T 7056b75012484d7fb7aa1ed31a4ebbd9 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:39.881214 25269 ts_tablet_manager.cc:1397] T 7056b75012484d7fb7aa1ed31a4ebbd9 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 18:14:39.882230 25269 raft_consensus.cc:348] T 7056b75012484d7fb7aa1ed31a4ebbd9 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.882503 25269 raft_consensus.cc:374] T 7056b75012484d7fb7aa1ed31a4ebbd9 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:39.882668 25269 raft_consensus.cc:729] T 7056b75012484d7fb7aa1ed31a4ebbd9 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:39.883037 25269 consensus_queue.cc:260] T 7056b75012484d7fb7aa1ed31a4ebbd9 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.883360 25269 raft_consensus.cc:388] T 7056b75012484d7fb7aa1ed31a4ebbd9 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:39.883512 25269 raft_consensus.cc:482] T 7056b75012484d7fb7aa1ed31a4ebbd9 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:39.883733 25269 raft_consensus.cc:3037] T 7056b75012484d7fb7aa1ed31a4ebbd9 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:39.886699 25269 raft_consensus.cc:504] T 7056b75012484d7fb7aa1ed31a4ebbd9 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.887009 25269 leader_election.cc:302] T 7056b75012484d7fb7aa1ed31a4ebbd9 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:39.887324 25269 leader_election.cc:288] T 7056b75012484d7fb7aa1ed31a4ebbd9 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:39.887411 25275 raft_consensus.cc:2781] T 7056b75012484d7fb7aa1ed31a4ebbd9 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:39.887730 25275 raft_consensus.cc:686] T 7056b75012484d7fb7aa1ed31a4ebbd9 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:39.888027 25275 consensus_queue.cc:237] T 7056b75012484d7fb7aa1ed31a4ebbd9 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.888208 25269 ts_tablet_manager.cc:1428] T 7056b75012484d7fb7aa1ed31a4ebbd9 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20260807 18:14:39.895915 24956 catalog_manager.cc:5495] T 7056b75012484d7fb7aa1ed31a4ebbd9 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:39.939894 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50210:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.137"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:39.955214 25147 tablet_service.cc:1467] Processing CreateTablet for tablet f8af32fce81e434180ebda859473b2bb (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.137 [id=e7e879a2055e4c70b4ba8964afa7acf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:39.955828 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8af32fce81e434180ebda859473b2bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:39.963838 25269 tablet_bootstrap.cc:492] T f8af32fce81e434180ebda859473b2bb P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:39.966322 25269 tablet_bootstrap.cc:654] T f8af32fce81e434180ebda859473b2bb P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:39.970587 25269 tablet_bootstrap.cc:492] T f8af32fce81e434180ebda859473b2bb P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:39.970844 25269 ts_tablet_manager.cc:1397] T f8af32fce81e434180ebda859473b2bb P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260807 18:14:39.972025 25269 raft_consensus.cc:348] T f8af32fce81e434180ebda859473b2bb P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.972342 25269 raft_consensus.cc:374] T f8af32fce81e434180ebda859473b2bb P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:39.972437 25269 raft_consensus.cc:729] T f8af32fce81e434180ebda859473b2bb P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:39.972759 25269 consensus_queue.cc:260] T f8af32fce81e434180ebda859473b2bb P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.972965 25269 raft_consensus.cc:388] T f8af32fce81e434180ebda859473b2bb P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:39.973111 25269 raft_consensus.cc:482] T f8af32fce81e434180ebda859473b2bb P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:39.973238 25269 raft_consensus.cc:3037] T f8af32fce81e434180ebda859473b2bb P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:39.975868 25269 raft_consensus.cc:504] T f8af32fce81e434180ebda859473b2bb P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.976176 25269 leader_election.cc:302] T f8af32fce81e434180ebda859473b2bb P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:39.976459 25269 leader_election.cc:288] T f8af32fce81e434180ebda859473b2bb P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:39.976630 25275 raft_consensus.cc:2781] T f8af32fce81e434180ebda859473b2bb P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:39.976892 25275 raft_consensus.cc:686] T f8af32fce81e434180ebda859473b2bb P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:39.976999 25269 ts_tablet_manager.cc:1428] T f8af32fce81e434180ebda859473b2bb P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260807 18:14:39.977424 25275 consensus_queue.cc:237] T f8af32fce81e434180ebda859473b2bb P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:39.986475 24956 catalog_manager.cc:5495] T f8af32fce81e434180ebda859473b2bb P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:39.996487 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000083
I20260807 18:14:40.012622 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.016s user 0.010s sys 0.004s Metrics: {"bytes_written":6068,"cfile_init":1,"dirs.queue_time_us":54,"dirs.run_cpu_time_us":178,"dirs.run_wall_time_us":2404,"drs_written":1,"lbm_read_time_us":82,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1090,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:40.013712 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.227323
I20260807 18:14:40.058789 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.045s user 0.038s sys 0.005s Metrics: {"bytes_written":66018,"cfile_cache_hit":13,"cfile_cache_hit_bytes":52137,"cfile_cache_miss":33,"cfile_cache_miss_bytes":77777,"cfile_init":9,"delta_iterators_relevant":6,"dirs.queue_time_us":665,"dirs.run_cpu_time_us":208,"dirs.run_wall_time_us":1499,"drs_written":1,"lbm_read_time_us":1781,"lbm_reads_lt_1ms":69,"lbm_write_time_us":1790,"lbm_writes_lt_1ms":30,"mutex_wait_us":106,"num_input_rowsets":2,"peak_mem_usage":39641,"rows_written":277}
I20260807 18:14:40.059787 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 12246 bytes on disk
I20260807 18:14:40.060433 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":61,"lbm_reads_lt_1ms":4}
I20260807 18:14:40.062624 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50224:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.138"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:40.074637 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 1220270f258f4a4dbed3ff650f4f5f23 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.138 [id=066a3d1f49c14b07bddd6c93bceaa5fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:40.075143 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1220270f258f4a4dbed3ff650f4f5f23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:40.080169 25269 tablet_bootstrap.cc:492] T 1220270f258f4a4dbed3ff650f4f5f23 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:40.083096 25269 tablet_bootstrap.cc:654] T 1220270f258f4a4dbed3ff650f4f5f23 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:40.087282 25269 tablet_bootstrap.cc:492] T 1220270f258f4a4dbed3ff650f4f5f23 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:40.087533 25269 ts_tablet_manager.cc:1397] T 1220270f258f4a4dbed3ff650f4f5f23 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260807 18:14:40.088600 25269 raft_consensus.cc:348] T 1220270f258f4a4dbed3ff650f4f5f23 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.088836 25269 raft_consensus.cc:374] T 1220270f258f4a4dbed3ff650f4f5f23 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:40.089066 25269 raft_consensus.cc:729] T 1220270f258f4a4dbed3ff650f4f5f23 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:40.089524 25269 consensus_queue.cc:260] T 1220270f258f4a4dbed3ff650f4f5f23 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.089780 25269 raft_consensus.cc:388] T 1220270f258f4a4dbed3ff650f4f5f23 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:40.089970 25269 raft_consensus.cc:482] T 1220270f258f4a4dbed3ff650f4f5f23 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:40.090233 25269 raft_consensus.cc:3037] T 1220270f258f4a4dbed3ff650f4f5f23 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:40.093295 25269 raft_consensus.cc:504] T 1220270f258f4a4dbed3ff650f4f5f23 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.093700 25269 leader_election.cc:302] T 1220270f258f4a4dbed3ff650f4f5f23 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:40.093993 25269 leader_election.cc:288] T 1220270f258f4a4dbed3ff650f4f5f23 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:40.094142 25275 raft_consensus.cc:2781] T 1220270f258f4a4dbed3ff650f4f5f23 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:40.094527 25275 raft_consensus.cc:686] T 1220270f258f4a4dbed3ff650f4f5f23 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:40.094735 25269 ts_tablet_manager.cc:1428] T 1220270f258f4a4dbed3ff650f4f5f23 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260807 18:14:40.094830 25275 consensus_queue.cc:237] T 1220270f258f4a4dbed3ff650f4f5f23 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.096069 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000086
I20260807 18:14:40.103722 24956 catalog_manager.cc:5495] T 1220270f258f4a4dbed3ff650f4f5f23 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:40.108665 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.009s sys 0.000s Metrics: {"bytes_written":6032,"cfile_init":1,"dirs.queue_time_us":67,"dirs.run_cpu_time_us":173,"dirs.run_wall_time_us":1187,"drs_written":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1017,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:40.110275 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.232241
I20260807 18:14:40.157032 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.046s user 0.035s sys 0.005s Metrics: {"bytes_written":66448,"cfile_cache_hit":13,"cfile_cache_hit_bytes":52476,"cfile_cache_miss":33,"cfile_cache_miss_bytes":78288,"cfile_init":9,"delta_iterators_relevant":6,"dirs.queue_time_us":948,"dirs.run_cpu_time_us":192,"dirs.run_wall_time_us":1326,"drs_written":1,"lbm_read_time_us":1560,"lbm_reads_lt_1ms":69,"lbm_write_time_us":1826,"lbm_writes_lt_1ms":30,"mutex_wait_us":218,"num_input_rowsets":2,"peak_mem_usage":39731,"rows_written":279,"spinlock_wait_cycles":28416}
I20260807 18:14:40.158020 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 12336 bytes on disk
I20260807 18:14:40.158612 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":106,"lbm_reads_lt_1ms":4}
I20260807 18:14:40.159922 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50238:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.139"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:40.173296 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 17465ae42d3a487f9e87679f85fe5861 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.139 [id=928d3600cfa8479eb23cfa4ab93896a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:40.173956 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17465ae42d3a487f9e87679f85fe5861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:40.180819 25269 tablet_bootstrap.cc:492] T 17465ae42d3a487f9e87679f85fe5861 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:40.183270 25269 tablet_bootstrap.cc:654] T 17465ae42d3a487f9e87679f85fe5861 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:40.187494 25269 tablet_bootstrap.cc:492] T 17465ae42d3a487f9e87679f85fe5861 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:40.187800 25269 ts_tablet_manager.cc:1397] T 17465ae42d3a487f9e87679f85fe5861 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 18:14:40.188961 25269 raft_consensus.cc:348] T 17465ae42d3a487f9e87679f85fe5861 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.189281 25269 raft_consensus.cc:374] T 17465ae42d3a487f9e87679f85fe5861 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:40.189491 25269 raft_consensus.cc:729] T 17465ae42d3a487f9e87679f85fe5861 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:40.189849 25269 consensus_queue.cc:260] T 17465ae42d3a487f9e87679f85fe5861 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.190092 25269 raft_consensus.cc:388] T 17465ae42d3a487f9e87679f85fe5861 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:40.190313 25269 raft_consensus.cc:482] T 17465ae42d3a487f9e87679f85fe5861 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:40.190528 25269 raft_consensus.cc:3037] T 17465ae42d3a487f9e87679f85fe5861 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:40.193012 25269 raft_consensus.cc:504] T 17465ae42d3a487f9e87679f85fe5861 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.193331 25269 leader_election.cc:302] T 17465ae42d3a487f9e87679f85fe5861 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:40.193673 25269 leader_election.cc:288] T 17465ae42d3a487f9e87679f85fe5861 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:40.193753 25275 raft_consensus.cc:2781] T 17465ae42d3a487f9e87679f85fe5861 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:40.193920 25275 raft_consensus.cc:686] T 17465ae42d3a487f9e87679f85fe5861 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:40.194159 25275 consensus_queue.cc:237] T 17465ae42d3a487f9e87679f85fe5861 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.194299 25269 ts_tablet_manager.cc:1428] T 17465ae42d3a487f9e87679f85fe5861 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.006s user 0.005s sys 0.002s
I20260807 18:14:40.204523 24956 catalog_manager.cc:5495] T 17465ae42d3a487f9e87679f85fe5861 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:40.247304 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50254:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.140"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:40.260136 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 4d6cbae92f1e490caefb1ebec72a8c82 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.140 [id=4288bb4c88d142ccad0d61bd5be04381]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:40.260773 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d6cbae92f1e490caefb1ebec72a8c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:40.268132 25269 tablet_bootstrap.cc:492] T 4d6cbae92f1e490caefb1ebec72a8c82 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:40.270817 25269 tablet_bootstrap.cc:654] T 4d6cbae92f1e490caefb1ebec72a8c82 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:40.274887 25269 tablet_bootstrap.cc:492] T 4d6cbae92f1e490caefb1ebec72a8c82 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:40.275142 25269 ts_tablet_manager.cc:1397] T 4d6cbae92f1e490caefb1ebec72a8c82 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260807 18:14:40.276551 25269 raft_consensus.cc:348] T 4d6cbae92f1e490caefb1ebec72a8c82 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.276785 25269 raft_consensus.cc:374] T 4d6cbae92f1e490caefb1ebec72a8c82 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:40.276983 25269 raft_consensus.cc:729] T 4d6cbae92f1e490caefb1ebec72a8c82 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:40.277419 25269 consensus_queue.cc:260] T 4d6cbae92f1e490caefb1ebec72a8c82 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.277756 25269 raft_consensus.cc:388] T 4d6cbae92f1e490caefb1ebec72a8c82 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:40.277935 25269 raft_consensus.cc:482] T 4d6cbae92f1e490caefb1ebec72a8c82 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:40.278175 25269 raft_consensus.cc:3037] T 4d6cbae92f1e490caefb1ebec72a8c82 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:40.280920 25269 raft_consensus.cc:504] T 4d6cbae92f1e490caefb1ebec72a8c82 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.281440 25269 leader_election.cc:302] T 4d6cbae92f1e490caefb1ebec72a8c82 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:40.281852 25275 raft_consensus.cc:2781] T 4d6cbae92f1e490caefb1ebec72a8c82 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:40.281872 25269 leader_election.cc:288] T 4d6cbae92f1e490caefb1ebec72a8c82 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:40.282084 25275 raft_consensus.cc:686] T 4d6cbae92f1e490caefb1ebec72a8c82 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:40.282351 25275 consensus_queue.cc:237] T 4d6cbae92f1e490caefb1ebec72a8c82 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.282766 25269 ts_tablet_manager.cc:1428] T 4d6cbae92f1e490caefb1ebec72a8c82 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.000s sys 0.008s
I20260807 18:14:40.292860 24956 catalog_manager.cc:5495] T 4d6cbae92f1e490caefb1ebec72a8c82 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:40.311744 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000083
I20260807 18:14:40.327361 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.015s user 0.009s sys 0.004s Metrics: {"bytes_written":6068,"cfile_init":1,"dirs.queue_time_us":75,"dirs.run_cpu_time_us":229,"dirs.run_wall_time_us":1495,"drs_written":1,"lbm_read_time_us":151,"lbm_reads_lt_1ms":4,"lbm_write_time_us":974,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:40.328292 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.202075
I20260807 18:14:40.336074 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50264:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.141"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:40.350247 25147 tablet_service.cc:1467] Processing CreateTablet for tablet be3487f837b945daada538eed4490b74 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.141 [id=4b8709adb4a0435dabc5c8c758e07771]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:40.350847 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be3487f837b945daada538eed4490b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:40.358274 25269 tablet_bootstrap.cc:492] T be3487f837b945daada538eed4490b74 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:40.360888 25269 tablet_bootstrap.cc:654] T be3487f837b945daada538eed4490b74 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:40.366691 25269 tablet_bootstrap.cc:492] T be3487f837b945daada538eed4490b74 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:40.367053 25269 ts_tablet_manager.cc:1397] T be3487f837b945daada538eed4490b74 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.005s
I20260807 18:14:40.368249 25269 raft_consensus.cc:348] T be3487f837b945daada538eed4490b74 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.368592 25269 raft_consensus.cc:374] T be3487f837b945daada538eed4490b74 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:40.368762 25269 raft_consensus.cc:729] T be3487f837b945daada538eed4490b74 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:40.369179 25269 consensus_queue.cc:260] T be3487f837b945daada538eed4490b74 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.369485 25269 raft_consensus.cc:388] T be3487f837b945daada538eed4490b74 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:40.369746 25269 raft_consensus.cc:482] T be3487f837b945daada538eed4490b74 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:40.369922 25269 raft_consensus.cc:3037] T be3487f837b945daada538eed4490b74 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:40.373049 25269 raft_consensus.cc:504] T be3487f837b945daada538eed4490b74 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.373553 25269 leader_election.cc:302] T be3487f837b945daada538eed4490b74 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:40.374001 25269 leader_election.cc:288] T be3487f837b945daada538eed4490b74 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:40.374147 25275 raft_consensus.cc:2781] T be3487f837b945daada538eed4490b74 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:40.374375 25275 raft_consensus.cc:686] T be3487f837b945daada538eed4490b74 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:40.374773 25275 consensus_queue.cc:237] T be3487f837b945daada538eed4490b74 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.375373 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.047s user 0.027s sys 0.020s Metrics: {"bytes_written":67300,"cfile_cache_hit":12,"cfile_cache_hit_bytes":53256,"cfile_cache_miss":30,"cfile_cache_miss_bytes":79104,"cfile_init":8,"delta_iterators_relevant":4,"dirs.queue_time_us":1015,"dirs.run_cpu_time_us":250,"dirs.run_wall_time_us":1833,"drs_written":1,"lbm_read_time_us":1502,"lbm_reads_lt_1ms":62,"lbm_write_time_us":1875,"lbm_writes_lt_1ms":30,"mutex_wait_us":211,"num_input_rowsets":2,"peak_mem_usage":39599,"rows_written":283}
I20260807 18:14:40.376390 25269 ts_tablet_manager.cc:1428] T be3487f837b945daada538eed4490b74 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.009s user 0.001s sys 0.009s
I20260807 18:14:40.376432 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000014
I20260807 18:14:40.391330 24956 catalog_manager.cc:5495] T be3487f837b945daada538eed4490b74 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:40.402181 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.025s user 0.014s sys 0.008s Metrics: {"bytes_written":5158,"cfile_init":1,"dirs.queue_time_us":68,"dirs.run_cpu_time_us":186,"dirs.run_wall_time_us":3388,"drs_written":1,"lbm_read_time_us":105,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1165,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:40.403301 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 12734 bytes on disk
I20260807 18:14:40.404174 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":196,"lbm_reads_lt_1ms":8}
I20260807 18:14:40.405299 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.216039
I20260807 18:14:40.409526 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000084
I20260807 18:14:40.421468 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.011s sys 0.000s Metrics: {"bytes_written":6068,"cfile_init":1,"dirs.queue_time_us":67,"dirs.run_cpu_time_us":195,"dirs.run_wall_time_us":1728,"drs_written":1,"lbm_read_time_us":85,"lbm_reads_lt_1ms":4,"lbm_write_time_us":992,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:40.422444 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 522 bytes on disk
I20260807 18:14:40.423090 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":95,"lbm_reads_lt_1ms":4}
I20260807 18:14:40.423774 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.227663
I20260807 18:14:40.437896 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.031s user 0.026s sys 0.004s Metrics: {"bytes_written":67747,"cfile_cache_hit":12,"cfile_cache_hit_bytes":53586,"cfile_cache_miss":30,"cfile_cache_miss_bytes":79332,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":1259,"dirs.run_cpu_time_us":263,"dirs.run_wall_time_us":1107,"drs_written":1,"lbm_read_time_us":1023,"lbm_reads_lt_1ms":58,"lbm_write_time_us":1251,"lbm_writes_lt_1ms":30,"mutex_wait_us":57,"num_input_rowsets":2,"peak_mem_usage":40477,"rows_written":285,"spinlock_wait_cycles":6400}
I20260807 18:14:40.438725 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 12588 bytes on disk
I20260807 18:14:40.439288 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":83,"lbm_reads_lt_1ms":4}
I20260807 18:14:40.452772 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50278:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.142"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:40.463294 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.039s user 0.026s sys 0.011s Metrics: {"bytes_written":67747,"cfile_cache_hit":12,"cfile_cache_hit_bytes":53621,"cfile_cache_miss":30,"cfile_cache_miss_bytes":79649,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":1049,"dirs.run_cpu_time_us":806,"dirs.run_wall_time_us":3725,"drs_written":1,"lbm_read_time_us":1481,"lbm_reads_lt_1ms":58,"lbm_write_time_us":1689,"lbm_writes_lt_1ms":30,"mutex_wait_us":258,"num_input_rowsets":2,"peak_mem_usage":40632,"rows_written":285,"spinlock_wait_cycles":4352}
I20260807 18:14:40.464473 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 12588 bytes on disk
I20260807 18:14:40.465132 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":90,"lbm_reads_lt_1ms":4}
I20260807 18:14:40.465829 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000012
I20260807 18:14:40.468075 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 6d9329232da946d18f688ef408303251 (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.142 [id=e07b8c76cbcf46f3afa7e0f4bad23e22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:40.468809 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d9329232da946d18f688ef408303251. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:40.478075 25269 tablet_bootstrap.cc:492] T 6d9329232da946d18f688ef408303251 P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:40.479763 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.014s user 0.011s sys 0.000s Metrics: {"bytes_written":5158,"cfile_init":1,"dirs.queue_time_us":58,"dirs.run_cpu_time_us":207,"dirs.run_wall_time_us":1232,"drs_written":1,"lbm_read_time_us":112,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1381,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:40.480698 25269 tablet_bootstrap.cc:654] T 6d9329232da946d18f688ef408303251 P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:40.480824 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 235 bytes on disk
I20260807 18:14:40.481639 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":119,"lbm_reads_lt_1ms":4}
I20260807 18:14:40.482218 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.158266
I20260807 18:14:40.485685 25269 tablet_bootstrap.cc:492] T 6d9329232da946d18f688ef408303251 P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:40.485925 25269 ts_tablet_manager.cc:1397] T 6d9329232da946d18f688ef408303251 P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.005s
I20260807 18:14:40.487099 25269 raft_consensus.cc:348] T 6d9329232da946d18f688ef408303251 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.487407 25269 raft_consensus.cc:374] T 6d9329232da946d18f688ef408303251 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:40.487634 25269 raft_consensus.cc:729] T 6d9329232da946d18f688ef408303251 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:40.487972 25269 consensus_queue.cc:260] T 6d9329232da946d18f688ef408303251 P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.488287 25269 raft_consensus.cc:388] T 6d9329232da946d18f688ef408303251 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:40.488452 25269 raft_consensus.cc:482] T 6d9329232da946d18f688ef408303251 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:40.488705 25269 raft_consensus.cc:3037] T 6d9329232da946d18f688ef408303251 P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:40.491411 25269 raft_consensus.cc:504] T 6d9329232da946d18f688ef408303251 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.491796 25269 leader_election.cc:302] T 6d9329232da946d18f688ef408303251 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:40.492199 25269 leader_election.cc:288] T 6d9329232da946d18f688ef408303251 P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:40.492228 25275 raft_consensus.cc:2781] T 6d9329232da946d18f688ef408303251 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:40.492393 25275 raft_consensus.cc:686] T 6d9329232da946d18f688ef408303251 P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:40.492638 25275 consensus_queue.cc:237] T 6d9329232da946d18f688ef408303251 P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.493312 25269 ts_tablet_manager.cc:1428] T 6d9329232da946d18f688ef408303251 P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260807 18:14:40.504042 24956 catalog_manager.cc:5495] T 6d9329232da946d18f688ef408303251 P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:40.523844 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.041s user 0.022s sys 0.019s Metrics: {"bytes_written":333,"cfile_cache_hit":12,"cfile_cache_hit_bytes":53961,"cfile_cache_miss":30,"cfile_cache_miss_bytes":79887,"cfile_init":7,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":1158,"dirs.run_cpu_time_us":222,"dirs.run_wall_time_us":1242,"drs_written":1,"lbm_read_time_us":1181,"lbm_reads_lt_1ms":58,"lbm_write_time_us":2289,"lbm_writes_lt_1ms":34,"num_input_rowsets":2,"peak_mem_usage":40645,"reinsert_count":0,"rows_written":287,"update_count":1}
I20260807 18:14:40.525079 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 12621 bytes on disk
I20260807 18:14:40.525668 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":78,"lbm_reads_lt_1ms":4}
I20260807 18:14:40.572669 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50288:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.143"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:40.585206 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 8fa4d3824f6840199ea6ec53a0859a2a (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.143 [id=1aa87eb96a6748cbb692650908f7bff1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:40.585772 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fa4d3824f6840199ea6ec53a0859a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:40.592540 25269 tablet_bootstrap.cc:492] T 8fa4d3824f6840199ea6ec53a0859a2a P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:40.595670 25269 tablet_bootstrap.cc:654] T 8fa4d3824f6840199ea6ec53a0859a2a P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:40.600562 25269 tablet_bootstrap.cc:492] T 8fa4d3824f6840199ea6ec53a0859a2a P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:40.600911 25269 ts_tablet_manager.cc:1397] T 8fa4d3824f6840199ea6ec53a0859a2a P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.005s
I20260807 18:14:40.602449 25269 raft_consensus.cc:348] T 8fa4d3824f6840199ea6ec53a0859a2a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.602810 25269 raft_consensus.cc:374] T 8fa4d3824f6840199ea6ec53a0859a2a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:40.603015 25269 raft_consensus.cc:729] T 8fa4d3824f6840199ea6ec53a0859a2a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:40.603454 25269 consensus_queue.cc:260] T 8fa4d3824f6840199ea6ec53a0859a2a P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.603750 25269 raft_consensus.cc:388] T 8fa4d3824f6840199ea6ec53a0859a2a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:40.604045 25269 raft_consensus.cc:482] T 8fa4d3824f6840199ea6ec53a0859a2a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:40.604257 25269 raft_consensus.cc:3037] T 8fa4d3824f6840199ea6ec53a0859a2a P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:40.607931 25269 raft_consensus.cc:504] T 8fa4d3824f6840199ea6ec53a0859a2a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.608431 25269 leader_election.cc:302] T 8fa4d3824f6840199ea6ec53a0859a2a P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:40.608894 25275 raft_consensus.cc:2781] T 8fa4d3824f6840199ea6ec53a0859a2a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:40.608894 25269 leader_election.cc:288] T 8fa4d3824f6840199ea6ec53a0859a2a P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:40.609149 25275 raft_consensus.cc:686] T 8fa4d3824f6840199ea6ec53a0859a2a P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:40.609512 25275 consensus_queue.cc:237] T 8fa4d3824f6840199ea6ec53a0859a2a P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.610016 25269 ts_tablet_manager.cc:1428] T 8fa4d3824f6840199ea6ec53a0859a2a P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.009s user 0.003s sys 0.007s
I20260807 18:14:40.619663 24956 catalog_manager.cc:5495] T 8fa4d3824f6840199ea6ec53a0859a2a P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:40.663174 24956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50292:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.144"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:40.676354 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 233e63a30b1e41dea1245feb7fc5664e (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.144 [id=29305cd74d3b465a88e5f1a3a8f1f9ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:40.676921 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 233e63a30b1e41dea1245feb7fc5664e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:40.684262 25269 tablet_bootstrap.cc:492] T 233e63a30b1e41dea1245feb7fc5664e P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:40.687402 25269 tablet_bootstrap.cc:654] T 233e63a30b1e41dea1245feb7fc5664e P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:40.690146 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000080
I20260807 18:14:40.692255 25269 tablet_bootstrap.cc:492] T 233e63a30b1e41dea1245feb7fc5664e P 62b8055ca6414187bd84f9b8d9b08741: No bootstrap required, opened a new log
I20260807 18:14:40.692556 25269 ts_tablet_manager.cc:1397] T 233e63a30b1e41dea1245feb7fc5664e P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.005s
I20260807 18:14:40.694380 25269 raft_consensus.cc:348] T 233e63a30b1e41dea1245feb7fc5664e P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.694815 25269 raft_consensus.cc:374] T 233e63a30b1e41dea1245feb7fc5664e P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:14:40.695040 25269 raft_consensus.cc:729] T 233e63a30b1e41dea1245feb7fc5664e P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Initialized, Role: FOLLOWER
I20260807 18:14:40.695389 25269 consensus_queue.cc:260] T 233e63a30b1e41dea1245feb7fc5664e P 62b8055ca6414187bd84f9b8d9b08741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.695765 25269 raft_consensus.cc:388] T 233e63a30b1e41dea1245feb7fc5664e P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:14:40.695945 25269 raft_consensus.cc:482] T 233e63a30b1e41dea1245feb7fc5664e P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:14:40.696168 25269 raft_consensus.cc:3037] T 233e63a30b1e41dea1245feb7fc5664e P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:14:40.700352 25269 raft_consensus.cc:504] T 233e63a30b1e41dea1245feb7fc5664e P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.700848 25269 leader_election.cc:302] T 233e63a30b1e41dea1245feb7fc5664e P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62b8055ca6414187bd84f9b8d9b08741; no voters:
I20260807 18:14:40.701165 25269 leader_election.cc:288] T 233e63a30b1e41dea1245feb7fc5664e P 62b8055ca6414187bd84f9b8d9b08741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:14:40.701284 25275 raft_consensus.cc:2781] T 233e63a30b1e41dea1245feb7fc5664e P 62b8055ca6414187bd84f9b8d9b08741 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:14:40.701691 25275 raft_consensus.cc:686] T 233e63a30b1e41dea1245feb7fc5664e P 62b8055ca6414187bd84f9b8d9b08741 [term 1 LEADER]: Becoming Leader. State: Replica: 62b8055ca6414187bd84f9b8d9b08741, State: Running, Role: LEADER
I20260807 18:14:40.701959 25275 consensus_queue.cc:237] T 233e63a30b1e41dea1245feb7fc5664e P 62b8055ca6414187bd84f9b8d9b08741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } }
I20260807 18:14:40.702263 25269 ts_tablet_manager.cc:1428] T 233e63a30b1e41dea1245feb7fc5664e P 62b8055ca6414187bd84f9b8d9b08741: Time spent starting tablet: real 0.009s user 0.007s sys 0.003s
I20260807 18:14:40.706081 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.016s user 0.011s sys 0.004s Metrics: {"bytes_written":6032,"cfile_init":1,"dirs.queue_time_us":57,"dirs.run_cpu_time_us":216,"dirs.run_wall_time_us":1290,"drs_written":1,"lbm_read_time_us":116,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1517,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
I20260807 18:14:40.707082 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.202662
I20260807 18:14:40.715691 24956 catalog_manager.cc:5495] T 233e63a30b1e41dea1245feb7fc5664e P 62b8055ca6414187bd84f9b8d9b08741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1). New cstate: current_term: 1 leader_uuid: "62b8055ca6414187bd84f9b8d9b08741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62b8055ca6414187bd84f9b8d9b08741" member_type: VOTER last_known_addr { host: "127.19.201.1" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260807 18:14:40.745291 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.038s user 0.029s sys 0.008s Metrics: {"bytes_written":336,"cfile_cache_hit":12,"cfile_cache_hit_bytes":54697,"cfile_cache_miss":30,"cfile_cache_miss_bytes":81209,"cfile_init":8,"delete_count":0,"delta_iterators_relevant":4,"dirs.queue_time_us":1119,"dirs.run_cpu_time_us":250,"dirs.run_wall_time_us":1249,"drs_written":1,"lbm_read_time_us":1779,"lbm_reads_lt_1ms":62,"lbm_write_time_us":1905,"lbm_writes_lt_1ms":34,"mutex_wait_us":44,"num_input_rowsets":2,"peak_mem_usage":41450,"reinsert_count":0,"rows_written":291,"update_count":1}
I20260807 18:14:40.746316 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 12822 bytes on disk
I20260807 18:14:40.747043 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":123,"lbm_reads_lt_1ms":4}
I20260807 18:14:40.764269 24957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50296:
name: "Table.TestRecoverDeadMasterSysCatalogCopy/0.145"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:14:40.776639 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000082
I20260807 18:14:40.778148 25147 tablet_service.cc:1467] Processing CreateTablet for tablet 24b50e35e00e44a0873308da6c94c7bf (DEFAULT_TABLE table=Table.TestRecoverDeadMasterSysCatalogCopy/0.145 [id=39ad1a96e9c94365b3b9b8f4c342e4e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:14:40.778849 25147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24b50e35e00e44a0873308da6c94c7bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:14:40.788379 25269 tablet_bootstrap.cc:492] T 24b50e35e00e44a0873308da6c94c7bf P 62b8055ca6414187bd84f9b8d9b08741: Bootstrap starting.
I20260807 18:14:40.790849 25269 tablet_bootstrap.cc:654] T 24b50e35e00e44a0873308da6c94c7bf P 62b8055ca6414187bd84f9b8d9b08741: Neither blocks nor log segments found. Creating new log.
I20260807 18:14:40.794152 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.017s user 0.009s sys 0.007s Metrics: {"bytes_written":6031,"cfile_init":1,"dirs.queue_time_us":67,"dirs.run_cpu_time_us":215,"dirs.run_wall_time_us":1214,"drs_written":1,"lbm_read_time_us":116,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1572,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":6}
W20260807 18:14:40.794728 25269 log.cc:1242] Error closing log: Illegal state: Log not open. State: 0
I20260807 18:14:40.795256 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 506 bytes on disk
I20260807 18:14:40.795905 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":121,"lbm_reads_lt_1ms":4}
E20260807 18:14:40.796272 25269 ts_tablet_manager.cc:1419] T 24b50e35e00e44a0873308da6c94c7bf P 62b8055ca6414187bd84f9b8d9b08741: Tablet failed to bootstrap: IO error: Failed to open new log: Insufficient disk space to allocate 8388608 bytes under path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0/minicluster-data/ts-0/wal/wals/24b50e35e00e44a0873308da6c94c7bf/.kudutmp.newsegmentYQeo2p (525795328 bytes available vs 518351011 bytes reserved) (error 28)
I20260807 18:14:40.796444 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.202403
I20260807 18:14:40.796480 25269 ts_tablet_manager.cc:1397] T 24b50e35e00e44a0873308da6c94c7bf P 62b8055ca6414187bd84f9b8d9b08741: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.005s
I20260807 18:14:40.796790 25269 tablet_replica.cc:330] T 24b50e35e00e44a0873308da6c94c7bf P 62b8055ca6414187bd84f9b8d9b08741: stopping tablet replica
I20260807 18:14:40.797012 25269 raft_consensus.cc:2229] T 24b50e35e00e44a0873308da6c94c7bf P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 18:14:40.797278 25269 raft_consensus.cc:2258] T 24b50e35e00e44a0873308da6c94c7bf P 62b8055ca6414187bd84f9b8d9b08741 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 18:14:40.840220 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.043s user 0.031s sys 0.012s Metrics: {"bytes_written":69474,"cfile_cache_hit":13,"cfile_cache_hit_bytes":55059,"cfile_cache_miss":33,"cfile_cache_miss_bytes":81985,"cfile_init":7,"delta_iterators_relevant":6,"dirs.queue_time_us":583,"dirs.run_cpu_time_us":264,"dirs.run_wall_time_us":1192,"drs_written":1,"lbm_read_time_us":1105,"lbm_reads_lt_1ms":61,"lbm_write_time_us":1554,"lbm_writes_lt_1ms":30,"mutex_wait_us":44,"num_input_rowsets":2,"peak_mem_usage":41557,"rows_written":293,"spinlock_wait_cycles":768}
I20260807 18:14:40.841162 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 12936 bytes on disk
I20260807 18:14:40.841854 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":80,"lbm_reads_lt_1ms":4}
I20260807 18:14:40.997997 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.000081
I20260807 18:14:41.011386 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.013s user 0.001s sys 0.010s Metrics: {"bytes_written":5158,"cfile_init":1,"dirs.queue_time_us":102,"dirs.run_cpu_time_us":351,"dirs.run_wall_time_us":1502,"drs_written":1,"lbm_read_time_us":79,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1102,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":2}
I20260807 18:14:41.012280 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.186442
I20260807 18:14:41.042905 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.030s user 0.027s sys 0.004s Metrics: {"bytes_written":69474,"cfile_cache_hit":13,"cfile_cache_hit_bytes":55065,"cfile_cache_miss":33,"cfile_cache_miss_bytes":81909,"cfile_init":9,"delta_iterators_relevant":6,"dirs.queue_time_us":1155,"dirs.run_cpu_time_us":241,"dirs.run_wall_time_us":1503,"drs_written":1,"lbm_read_time_us":1533,"lbm_reads_lt_1ms":69,"lbm_write_time_us":1499,"lbm_writes_lt_1ms":30,"mutex_wait_us":114,"num_input_rowsets":2,"peak_mem_usage":41686,"rows_written":293}
I20260807 18:14:41.043816 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 12936 bytes on disk
I20260807 18:14:41.044492 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":85,"lbm_reads_lt_1ms":4}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/dynamic_multi_master-test.cc:403: Failure
Failed
Bad status: Timed out: Timed out waiting for Table Creation
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/dynamic_multi_master-test.cc:1111: Failure
Expected: StartClusterWithSysCatalogGCed( &master_hps, {"--consensus_rpc_timeout_ms=2000", "--follower_unavailable_considered_failed_sec=4"}) doesn't generate new fatal failures in the current thread.
Actual: it does.
I20260807 18:15:10.710161 20260 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskorkq8y/build/asan/bin/kudu pid 25062
I20260807 18:15:10.722996 25234 generic_service.cc:196] Checking for leaks (request via RPC)
W20260807 18:15:10.821156 25029 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e: Tablet 24b50e35e00e44a0873308da6c94c7bf (table Table.TestRecoverDeadMasterSysCatalogCopy/0.145 [id=39ad1a96e9c94365b3b9b8f4c342e4e8]) was not created within the allowed timeout. Replacing with a new tablet f5f555efddf9444d94e0b7826f633861
I20260807 18:15:10.831461 25029 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8f33b01addea43bbb634aaebb43d272e: Sending DeleteTablet for 1 replicas of tablet 24b50e35e00e44a0873308da6c94c7bf
I20260807 18:15:10.849680 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.008288
I20260807 18:15:10.860193 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.010s user 0.007s sys 0.001s Metrics: {"bytes_written":5000,"cfile_init":1,"dirs.queue_time_us":464,"dirs.run_cpu_time_us":207,"dirs.run_wall_time_us":771,"drs_written":1,"lbm_read_time_us":72,"lbm_reads_lt_1ms":4,"lbm_write_time_us":835,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":1,"thread_start_us":348,"threads_started":1}
I20260807 18:15:10.861143 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.014977
I20260807 18:15:10.889936 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.028s user 0.022s sys 0.006s Metrics: {"bytes_written":69753,"cfile_cache_hit":12,"cfile_cache_hit_bytes":55283,"cfile_cache_miss":30,"cfile_cache_miss_bytes":81829,"cfile_init":8,"delta_iterators_relevant":4,"dirs.queue_time_us":1240,"dirs.run_cpu_time_us":1018,"dirs.run_wall_time_us":3602,"drs_written":1,"lbm_read_time_us":1167,"lbm_reads_lt_1ms":62,"lbm_write_time_us":1029,"lbm_writes_lt_1ms":30,"mutex_wait_us":76,"num_input_rowsets":2,"peak_mem_usage":41752,"rows_written":294,"spinlock_wait_cycles":20736,"thread_start_us":1552,"threads_started":3}
I20260807 18:15:10.890887 24844 maintenance_manager.cc:419] P 57c0c70cc04f4c73ae2bc598047c15e5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 12930 bytes on disk
I20260807 18:15:10.891513 24843 maintenance_manager.cc:643] P 57c0c70cc04f4c73ae2bc598047c15e5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":75,"lbm_reads_lt_1ms":4}
I20260807 18:15:10.898417 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.008362
I20260807 18:15:10.920684 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.022s user 0.017s sys 0.002s Metrics: {"bytes_written":5000,"cfile_init":1,"dirs.queue_time_us":486,"dirs.run_cpu_time_us":203,"dirs.run_wall_time_us":820,"drs_written":1,"lbm_read_time_us":70,"lbm_reads_lt_1ms":4,"lbm_write_time_us":862,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":1,"thread_start_us":340,"threads_started":1}
I20260807 18:15:10.921684 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 163 bytes on disk
I20260807 18:15:10.922262 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":81,"lbm_reads_lt_1ms":4}
I20260807 18:15:10.922905 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling CompactRowSetsOp(00000000000000000000000000000000): perf score=0.014977
I20260807 18:15:10.951064 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: CompactRowSetsOp(00000000000000000000000000000000) complete. Timing: real 0.028s user 0.027s sys 0.000s Metrics: {"bytes_written":69753,"cfile_cache_hit":12,"cfile_cache_hit_bytes":55283,"cfile_cache_miss":30,"cfile_cache_miss_bytes":81829,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":1360,"dirs.run_cpu_time_us":1131,"dirs.run_wall_time_us":4674,"drs_written":1,"lbm_read_time_us":911,"lbm_reads_lt_1ms":58,"lbm_write_time_us":917,"lbm_writes_lt_1ms":30,"num_input_rowsets":2,"peak_mem_usage":41752,"rows_written":294,"spinlock_wait_cycles":3328,"thread_start_us":1865,"threads_started":3}
I20260807 18:15:10.951820 24939 maintenance_manager.cc:419] P 8f33b01addea43bbb634aaebb43d272e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 12930 bytes on disk
I20260807 18:15:10.952340 24938 maintenance_manager.cc:643] P 8f33b01addea43bbb634aaebb43d272e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":63,"lbm_reads_lt_1ms":4}
I20260807 18:15:11.044026 20260 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskorkq8y/build/asan/bin/kudu with pid 25062
W20260807 18:15:11.106166 24841 connection.cc:535] server connection from 127.19.201.1:60401 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 18:15:11.106439 24936 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.201.1:45829 (error 108)
I20260807 18:15:11.107311 20260 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskorkq8y/build/asan/bin/kudu pid 24815
I20260807 18:15:11.108947 24895 generic_service.cc:196] Checking for leaks (request via RPC)
W20260807 18:15:11.109221 24936 catalog_manager.cc:4584] TS 62b8055ca6414187bd84f9b8d9b08741 (127.19.201.1:45829): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 24b50e35e00e44a0873308da6c94c7bf: Network error: Client connection negotiation failed: client connection to 127.19.201.1:45829: connect: Connection refused (error 111)
I20260807 18:15:11.297015 20260 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskorkq8y/build/asan/bin/kudu with pid 24815
I20260807 18:15:11.344045 20260 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskorkq8y/build/asan/bin/kudu pid 24906
I20260807 18:15:11.345172 24999 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 18:15:11.557843 20260 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskorkq8y/build/asan/bin/kudu with pid 24906
2026-08-07T18:15:11Z chronyd exiting
I20260807 18:15:11.619913 20260 test_util.cc:175] -----------------------------------------------
I20260807 18:15:11.620059 20260 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy_0.1786126423027121-20260-0
[ FAILED ] ParameterizedRecoverMasterTest.TestRecoverDeadMasterSysCatalogCopy/0, where GetParam() = 2 (45608 ms)
[----------] 1 test from ParameterizedRecoverMasterTest (45608 ms total)
[----------] 1 test from ParameterizedAutoAddMasterTest
[ RUN ] ParameterizedAutoAddMasterTest.TestBasicAddition/2_orig_masters_not_secure
2026-08-07T18:15:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:15:11Z Disabled control of system clock
I20260807 18:15:11.673194 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.62:36743
--webserver_interface=127.19.201.62
--webserver_port=0
--builtin_ntp_servers=127.19.201.20:44745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.201.62:36743,127.19.201.61:36001 with env {}
W20260807 18:15:12.046229 26905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:15:12.046554 26905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:15:12.046639 26905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:15:12.054062 26905 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:15:12.054173 26905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:15:12.054216 26905 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:15:12.054267 26905 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:15:12.063685 26905 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:44745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.201.62:36743,127.19.201.61:36001
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.62:36743
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.201.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
W20260807 18:15:12.064055 26905 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.19.201.62:36743,127.19.201.61:36001'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 18:15:12.065156 26905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:15:12.067119 26905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:15:12.079957 26911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:15:12.079921 26913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:15:12.079912 26915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:15:12.081065 26905 server_base.cc:1034] running on GCE node
I20260807 18:15:12.082060 26905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:15:12.083716 26905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:15:12.084939 26905 hybrid_clock.cc:648] HybridClock initialized: now 1786126512084878 us; error 53 us; skew 500 ppm
I20260807 18:15:12.085409 26905 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:15:12.087998 26905 webserver.cc:460] Webserver started at http://127.19.201.62:41987/ using document root <none> and password file <none>
I20260807 18:15:12.088886 26905 fs_manager.cc:359] Metadata directory not provided
I20260807 18:15:12.089015 26905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:15:12.089433 26905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:15:12.092489 26905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-0/data/instance:
uuid: "0eec124cda77406c9338d7e8e63608f0"
format_stamp: "Formatted at 2026-08-07 18:15:12 on dist-test-slave-bw88"
I20260807 18:15:12.093421 26905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-0/wal/instance:
uuid: "0eec124cda77406c9338d7e8e63608f0"
format_stamp: "Formatted at 2026-08-07 18:15:12 on dist-test-slave-bw88"
I20260807 18:15:12.099130 26905 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 18:15:12.103178 26922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:15:12.104832 26905 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 18:15:12.105053 26905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-0/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-0/wal
uuid: "0eec124cda77406c9338d7e8e63608f0"
format_stamp: "Formatted at 2026-08-07 18:15:12 on dist-test-slave-bw88"
I20260807 18:15:12.105316 26905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:15:12.124609 26905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:15:12.125614 26905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:15:12.125943 26905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:15:12.145417 26905 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.62:36743
I20260807 18:15:12.145476 26991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.62:36743 every 8 connection(s)
I20260807 18:15:12.146912 26905 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-0/data/info.pb
I20260807 18:15:12.151001 26992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:15:12.155236 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 26905
I20260807 18:15:12.155463 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-0/wal/instance
I20260807 18:15:12.157168 20260 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskorkq8y/build/asan/bin/kudu
/tmp/dist-test-taskorkq8y/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.61:36001
--webserver_interface=127.19.201.61
--webserver_port=0
--builtin_ntp_servers=127.19.201.20:44745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.201.62:36743,127.19.201.61:36001 with env {}
I20260807 18:15:12.158934 26992 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36743 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:15:12.180578 26992 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.61" port: 36001 } has no permanent_uuid. Determining permanent_uuid...
W20260807 18:15:12.181942 26925 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.201.61:36001: connect: Connection refused (error 111)
W20260807 18:15:12.183663 26992 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:36001: Network error: Client connection negotiation failed: client connection to 127.19.201.61:36001: connect: Connection refused (error 111)
I20260807 18:15:12.233137 26992 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 36001 } attempt: 1
W20260807 18:15:12.235327 26992 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:36001: Network error: Client connection negotiation failed: client connection to 127.19.201.61:36001: connect: Connection refused (error 111)
I20260807 18:15:12.303648 26992 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 36001 } attempt: 2
W20260807 18:15:12.306780 26992 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:36001: Network error: Client connection negotiation failed: client connection to 127.19.201.61:36001: connect: Connection refused (error 111)
I20260807 18:15:12.398115 26992 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 36001 } attempt: 3
W20260807 18:15:12.400264 26992 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:36001: Network error: Client connection negotiation failed: client connection to 127.19.201.61:36001: connect: Connection refused (error 111)
W20260807 18:15:12.522202 27000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:15:12.522513 27000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:15:12.522593 27000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:15:12.529799 27000 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:15:12.529909 27000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:15:12.529956 27000 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:15:12.530005 27000 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:15:12.539361 27000 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.201.20:44745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.201.62:36743,127.19.201.61:36001
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.201.61:36001
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.201.61
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
W20260807 18:15:12.539731 27000 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.19.201.62:36743,127.19.201.61:36001'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 18:15:12.540880 27000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:15:12.542840 27000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 18:15:12.543584 26992 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 36001 } attempt: 4
W20260807 18:15:12.545943 26992 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:36001: Network error: Client connection negotiation failed: client connection to 127.19.201.61:36001: connect: Connection refused (error 111)
W20260807 18:15:12.555975 27007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:15:12.555871 27011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:15:12.555894 27008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:15:12.556830 27000 server_base.cc:1034] running on GCE node
I20260807 18:15:12.557780 27000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:15:12.559342 27000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:15:12.560580 27000 hybrid_clock.cc:648] HybridClock initialized: now 1786126512560523 us; error 39 us; skew 500 ppm
I20260807 18:15:12.560963 27000 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:15:12.563549 27000 webserver.cc:460] Webserver started at http://127.19.201.61:44777/ using document root <none> and password file <none>
I20260807 18:15:12.564601 27000 fs_manager.cc:359] Metadata directory not provided
I20260807 18:15:12.564749 27000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:15:12.565222 27000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:15:12.568126 27000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-1/data/instance:
uuid: "a7b710348fe4457095c18a702974ddae"
format_stamp: "Formatted at 2026-08-07 18:15:12 on dist-test-slave-bw88"
I20260807 18:15:12.569006 27000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-1/wal/instance:
uuid: "a7b710348fe4457095c18a702974ddae"
format_stamp: "Formatted at 2026-08-07 18:15:12 on dist-test-slave-bw88"
I20260807 18:15:12.574837 27000 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 18:15:12.578816 27021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:15:12.580370 27000 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:15:12.580577 27000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-1/data,/tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-1/wal
uuid: "a7b710348fe4457095c18a702974ddae"
format_stamp: "Formatted at 2026-08-07 18:15:12 on dist-test-slave-bw88"
I20260807 18:15:12.580852 27000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:15:12.594760 27000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:15:12.595616 27000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:15:12.595911 27000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:15:12.616431 27000 rpc_server.cc:307] RPC server started. Bound to: 127.19.201.61:36001
I20260807 18:15:12.616465 27085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.201.61:36001 every 8 connection(s)
I20260807 18:15:12.618081 27000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-1/data/info.pb
I20260807 18:15:12.622279 27086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:15:12.623220 20260 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskorkq8y/build/asan/bin/kudu as pid 27000
I20260807 18:15:12.623400 20260 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-1/wal/instance
I20260807 18:15:12.631263 27086 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.62" port: 36743 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:15:12.645092 27086 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.201.61" port: 36001 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:15:12.656127 27086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7b710348fe4457095c18a702974ddae: Bootstrap starting.
I20260807 18:15:12.659776 27086 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a7b710348fe4457095c18a702974ddae: Neither blocks nor log segments found. Creating new log.
I20260807 18:15:12.660923 27086 log.cc:824] T 00000000000000000000000000000000 P a7b710348fe4457095c18a702974ddae: Log is configured to *not* fsync() on all Append() calls
W20260807 18:15:12.662501 27086 log.cc:1242] Error closing log: Illegal state: Log not open. State: 0
I20260807 18:15:12.663591 27086 tablet_replica.cc:330] T 00000000000000000000000000000000 P a7b710348fe4457095c18a702974ddae: stopping tablet replica
I20260807 18:15:12.663825 27086 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a7b710348fe4457095c18a702974ddae [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 18:15:12.664095 27086 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a7b710348fe4457095c18a702974ddae [term 0 FOLLOWER]: Raft consensus is shut down!
E20260807 18:15:12.665071 27086 master.cc:392] Unable to init master catalog manager: IO error: Unable to initialize catalog manager: Failed to initialize sys tables async: failed to bootstrap system catalog: Failed to open new log: Insufficient disk space to allocate 8388608 bytes under path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000/.kudutmp.newsegmentWOnlv3 (522272768 bytes available vs 518351011 bytes reserved) (error 28)
I20260807 18:15:12.665406 27000 master.cc:537] Master@127.19.201.61:36001 shutting down...
W20260807 18:15:12.677172 26900 connection.cc:535] client connection to 127.19.201.61:36001 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 18:15:12.689659 27000 master.cc:552] Master@127.19.201.61:36001 shutdown complete.
IO error: Unable to initialize catalog manager: Failed to initialize sys tables async: failed to bootstrap system catalog: Failed to open new log: Insufficient disk space to allocate 8388608 bytes under path /tmp/dist-test-taskorkq8y/test-tmp/dynamic_multi_master-test.0.ParameterizedAutoAddMasterTest.TestBasicAddition_2_orig_masters_not_secure.1786126423027121-20260-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000/.kudutmp.newsegmentWOnlv3 (522272768 bytes available vs 518351011 bytes reserved) (error 28)
I20260807 18:15:12.845252 26992 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 36001 } attempt: 5
W20260807 18:15:12.847244 26992 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:36001: Network error: Client connection negotiation failed: client connection to 127.19.201.61:36001: connect: Connection refused (error 111)
I20260807 18:15:13.394555 26992 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 36001 } attempt: 6
W20260807 18:15:13.397377 26992 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:36001: Network error: Client connection negotiation failed: client connection to 127.19.201.61:36001: connect: Connection refused (error 111)
I20260807 18:15:14.457782 26992 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 36001 } attempt: 7
W20260807 18:15:14.460613 26992 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:36001: Network error: Client connection negotiation failed: client connection to 127.19.201.61:36001: connect: Connection refused (error 111)
I20260807 18:15:16.550987 26992 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.201.61" port: 36001 } attempt: 8
W20260807 18:15:16.554127 26992 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.201.61:36001: Network error: Client connection negotiation failed: client connection to 127.19.201.61:36001: connect: Connection refused (error 111)
F20260807 18:15:17.709277 20260 external_mini_cluster.cc:634] Check failed: leader_master() != nullptr Must have started at least 1 master before adding tablet servers
*** Check failure stack trace: ***
*** Aborted at 1786126517 (unix time) try "date -d @1786126517" if you are using GNU date ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800004f24) received by PID 20260 (TID 0x7f4e020b1d40) from PID 20260; stack trace: ***
@ 0x7f4e057fda46 google::(anonymous namespace)::FailureSignalHandler() at ??:0
@ 0x7f4e0d84d980 (unknown) at ??:0
@ 0x7f4e02da1e87 gsignal at ??:0
@ 0x7f4e02da37f1 abort at ??:0
@ 0x7f4e057ef9ad google::LogMessage::Fail() at ??:0
@ 0x7f4e057f288a google::LogMessage::SendToLog() at ??:0
@ 0x7f4e057ef4de google::LogMessage::Flush() at ??:0
@ 0x7f4e057f0a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f4e1b243bc5 kudu::cluster::ExternalMiniCluster::AddTabletServer() at ??:0
@ 0x7f4e1b23d3f0 kudu::cluster::ExternalMiniCluster::Start() at ??:0
@ 0x55506a kudu::master::AutoAddMasterTest::SetUpWithTestArgs() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/dynamic_multi_master-test.cc:1466
@ 0x555aa1 kudu::master::ParameterizedAutoAddMasterTest::SetUp() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/dynamic_multi_master-test.cc:1824
@ 0x7f4e0760cbfe testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
@ 0x7f4e07601566 testing::Test::Run() at ??:0
@ 0x7f4e07601795 testing::TestInfo::Run() at ??:0
@ 0x7f4e07601cdf testing::TestSuite::Run() at ??:0
@ 0x7f4e0760229f testing::internal::UnitTestImpl::RunAllTests() at ??:0
@ 0x7f4e0760d13e testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
@ 0x7f4e0760183d testing::UnitTest::Run() at ??:0
@ 0x5d3fa2 RUN_ALL_TESTS() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/uninstrumented/include/gtest/gtest.h:2293
@ 0x5d24b2 main at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_main.cc:109
@ 0x7f4e02d84c87 __libc_start_main at ??:0
@ 0x413329 (unknown) at ??:?